Nov 28 00:37:09 user nova-compute[75266]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75266) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75266) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75266) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 00:37:09 user nova-compute[75266]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:37:09 user nova-compute[75266]: INFO nova.virt.driver [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 00:37:09 user nova-compute[75266]: INFO nova.compute.provider_config [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Acquiring lock "singleton_lock" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Acquired lock "singleton_lock" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Releasing lock "singleton_lock" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Full set of CONF: {{(pid=75266) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ******************************************************************************** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Configuration options gathered from: {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ================================================================================ {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] allow_resize_to_same_host      = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] arq_binding_timeout            = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] backdoor_port                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] backdoor_socket                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] block_device_allocate_retries  = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] block_device_allocate_retries_interval = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cert                           = self.pem {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute_monitors               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] config_dir                     = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] config_drive_format            = iso9660 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] config_source                  = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] console_host                   = user {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] control_exchange               = nova {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cpu_allocation_ratio           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] daemon                         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] debug                          = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_access_ip_network_name = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_availability_zone      = nova {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_ephemeral_format       = ext4 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_green_pool_size        = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] default_schedule_zone          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] disk_allocation_ratio          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] enable_new_services            = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] enabled_ssl_apis               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] flat_injected                  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] force_config_drive             = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] force_raw_images               = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] graceful_shutdown_timeout      = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] heal_instance_info_cache_interval = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] host                           = user {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_build_timeout         = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_delete_interval       = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:09 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_name_template         = instance-%08x {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_usage_audit           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_usage_audit_period    = month {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] internal_service_availability_zone = internal {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] key                            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] live_migration_retry_count     = 30 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_config_append              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_dir                        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_file                       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_options                    = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_rotate_interval            = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_rotate_interval_type       = days {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] log_rotation_type              = none {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] long_rpc_timeout               = 1800 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_concurrent_builds          = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_concurrent_live_migrations = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_concurrent_snapshots       = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_local_block_devices        = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_logfile_count              = 30 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] max_logfile_size_mb            = 200 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] maximum_instance_delete_attempts = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metadata_listen                = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metadata_listen_port           = 8775 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metadata_workers               = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] migrate_max_retries            = -1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] mkisofs_cmd                    = genisoimage {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] my_ip                          = 10.0.0.210 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] network_allocate_retries       = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] osapi_compute_listen_port      = 8774 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] osapi_compute_unique_server_name_scope =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] osapi_compute_workers          = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] password_length                = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] periodic_enable                = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] periodic_fuzzy_delay           = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] pointer_model                  = ps2mouse {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] preallocate_images             = none {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] publish_errors                 = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] pybasedir                      = /opt/stack/nova {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ram_allocation_ratio           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rate_limit_burst               = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rate_limit_except_level        = CRITICAL {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rate_limit_interval            = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reboot_timeout                 = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reclaim_instance_interval      = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] record                         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reimage_timeout_per_gb         = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] report_interval                = 120 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rescue_timeout                 = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reserved_host_cpus             = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reserved_host_disk_mb          = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reserved_host_memory_mb        = 512 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] reserved_huge_pages            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] resize_confirm_window          = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] resize_fs_using_block_device   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] resume_guests_state_on_host_boot = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rpc_response_timeout           = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] run_external_periodic_tasks    = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] running_deleted_instance_action = reap {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] running_deleted_instance_timeout = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler_instance_sync_interval = 120 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_down_time              = 720 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] servicegroup_driver            = db {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] shelved_offload_time           = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] shelved_poll_interval          = 3600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] shutdown_timeout               = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] source_is_ipv6                 = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ssl_only                       = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] state_path                     = /opt/stack/data/nova {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] sync_power_state_interval      = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] sync_power_state_pool_size     = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] syslog_log_facility            = LOG_USER {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] tempdir                        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] timeout_nbd                    = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] transport_url                  = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] update_resources_interval      = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_cow_images                 = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_eventlog                   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_journal                    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_json                       = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_rootwrap_daemon            = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_stderr                     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] use_syslog                     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vcpu_pin_set                   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plugging_is_fatal          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plugging_timeout           = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] virt_mkfs                      = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] volume_usage_poll_interval     = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] watch_log_file                 = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] web                            = /usr/share/spice-html5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.auth_strategy              = keystone {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.compute_link_prefix        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.dhcp_domain                = novalocal {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.enable_instance_password   = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.glance_link_prefix         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.instance_list_per_project_cells = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.list_records_by_skipping_down_cells = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.local_metadata_per_cell    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.max_limit                  = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.metadata_cache_expiration  = 15 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.neutron_default_tenant_id  = default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.use_forwarded_for          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.use_neutron_default_nets   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_dynamic_targets = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_jsonfile_path   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.backend_argument         = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.config_prefix            = cache.oslo {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.dead_timeout             = 60.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.debug_cache_backend      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.enable_retry_client      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.enable_socket_keepalive  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.enabled                  = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.expiration_time          = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_dead_retry      = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_password        =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_sasl_enabled    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.memcache_username        =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.proxies                  = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.retry_attempts           = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.retry_delay              = 0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.socket_keepalive_count   = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.socket_keepalive_idle    = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.socket_keepalive_interval = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.tls_allowed_ciphers      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.tls_cafile               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.tls_certfile             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.tls_enabled              = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cache.tls_keyfile              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.auth_section            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.auth_type               = password {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.cafile                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.certfile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.collect_timing          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.cross_az_attach         = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.debug                   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.endpoint_template       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.http_retries            = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.insecure                = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.keyfile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.os_region_name          = RegionOne {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.split_loggers           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cinder.timeout                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.cpu_dedicated_set      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.cpu_shared_set         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.image_type_exclude_list = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.resource_provider_association_refresh = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.shutdown_retry_interval = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] conductor.workers              = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] console.allowed_origins        = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] console.ssl_ciphers            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] console.ssl_minimum_version    = default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] consoleauth.token_ttl          = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.cafile                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.certfile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.collect_timing          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.connect_retries         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.connect_retry_delay     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.endpoint_override       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.insecure                = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.keyfile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.max_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.min_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.region_name             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.service_name            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.service_type            = accelerator {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.split_loggers           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.status_code_retries     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.timeout                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] cyborg.version                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.backend               = sqlalchemy {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.connection            = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.connection_debug      = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.connection_parameters =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.connection_recycle_time = 3600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.connection_trace      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.db_inc_retry_interval = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.db_max_retries        = 20 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.db_max_retry_interval = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.db_retry_interval     = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.max_overflow          = 50 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.max_pool_size         = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.max_retries           = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.pool_timeout          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.retry_interval        = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.slave_connection      = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] database.sqlite_synchronous    = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.backend           = sqlalchemy {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.connection        = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.connection_debug  = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.connection_parameters =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.connection_recycle_time = 3600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.connection_trace  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.db_inc_retry_interval = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.db_max_retries    = 20 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.db_max_retry_interval = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.db_retry_interval = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.max_overflow      = 50 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.max_pool_size     = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.max_retries       = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.pool_timeout      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.retry_interval    = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.slave_connection  = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] api_database.sqlite_synchronous = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] devices.enabled_mdev_types     = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ephemeral_storage_encryption.enabled = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.api_servers             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.cafile                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.certfile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.collect_timing          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.connect_retries         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.connect_retry_delay     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.debug                   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.default_trusted_certificate_ids = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.enable_certificate_validation = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.enable_rbd_download     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.endpoint_override       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.insecure                = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.keyfile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.max_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.min_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.num_retries             = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.rbd_ceph_conf           =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.rbd_connect_timeout     = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.rbd_pool                =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.rbd_user                =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.region_name             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.service_name            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.service_type            = image {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.split_loggers           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.status_code_retries     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.timeout                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.verify_glance_signatures = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] glance.version                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] guestfs.debug                  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.config_drive_cdrom      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.config_drive_inject_password = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.enable_remotefx         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.instances_path_share    =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.limit_cpu_features      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.use_multipath_io        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.vswitch_name            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] mks.enabled                    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.manager_interval   = 2400 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.precache_concurrency = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.remove_unused_base_images = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] image_cache.subdirectory_name  = _base {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.api_max_retries         = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.api_retry_interval      = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.auth_section            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.auth_type               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.cafile                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.certfile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.collect_timing          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.conductor_group         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.connect_retries         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.connect_retry_delay     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.endpoint_override       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.insecure                = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.keyfile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.max_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.min_version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.peer_list               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.region_name             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.serial_console_state_timeout = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.service_name            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.service_type            = baremetal {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.split_loggers           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.status_code_retries     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.timeout                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ironic.version                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] key_manager.fixed_key          = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.barbican_api_version  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.barbican_endpoint     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.barbican_endpoint_type = public {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.barbican_region_name  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.cafile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.certfile              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.collect_timing        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.insecure              = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.keyfile               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.number_of_retries     = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.retry_delay           = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.send_service_user_token = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.split_loggers         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.timeout               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.verify_ssl            = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican.verify_ssl_path       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.auth_section = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.auth_type = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.cafile   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.certfile = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.collect_timing = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.insecure = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.keyfile  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.split_loggers = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] barbican_service_user.timeout  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.approle_role_id          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.approle_secret_id        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.cafile                   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.certfile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.collect_timing           = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.insecure                 = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.keyfile                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.kv_mountpoint            = secret {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.kv_path                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.kv_version               = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.namespace                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.root_token_id            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.split_loggers            = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.ssl_ca_crt_file          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.timeout                  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.use_ssl                  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.auth_section          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.auth_type             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.cafile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.certfile              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.collect_timing        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.connect_retries       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.connect_retry_delay   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.endpoint_override     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.insecure              = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.keyfile               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.max_version           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.min_version           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.region_name           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.service_name          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.service_type          = identity {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.split_loggers         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.status_code_retries   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.timeout               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] keystone.version               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.connection_uri         =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_mode               = custom {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: WARNING oslo_config.cfg [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_power_governor_high = performance {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_power_management   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.device_detach_attempts = 8 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.device_detach_timeout  = 20 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.disk_cachemodes        = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.disk_prefix            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.enabled_perf_events    = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.file_backed_memory     = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.gid_maps               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.hw_disk_discard        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.hw_machine_type        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_rbd_pool        = rbd {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_type            = default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.images_volume_group    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.inject_key             = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.inject_partition       = -2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.inject_password        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.iscsi_iface            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.iser_use_multipath     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_downtime = 500 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_inbound_addr = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_scheme  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_timeout_action = abort {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_tunnelled = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: WARNING oslo_config.cfg [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 00:37:10 user nova-compute[75266]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 00:37:10 user nova-compute[75266]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 00:37:10 user nova-compute[75266]: and ``live_migration_inbound_addr`` respectively.
Nov 28 00:37:10 user nova-compute[75266]: ).  Its value may be silently ignored in the future.
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.live_migration_with_native_tls = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.max_queues             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.nfs_mount_options      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_pcie_ports         = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.pmem_namespaces        = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.quobyte_client_cfg     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rbd_secret_uuid        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rbd_user               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rescue_image_id        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rescue_kernel_id       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.rx_queue_size          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.smbfs_mount_options    =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.snapshot_compression   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.snapshot_image_format  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.sparse_logical_volumes = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.swtpm_enabled          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.swtpm_group            = tss {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.swtpm_user             = tss {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.sysinfo_serial         = unique {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.tb_cache_size          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.tx_queue_size          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.uid_maps               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.use_virtio_for_bridges = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.virt_type              = kvm {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.volume_clear           = zero {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.volume_clear_size      = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.volume_use_multipath   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_cache_path   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.auth_section           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.auth_type              = password {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.cafile                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.certfile               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.collect_timing         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.connect_retries        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.connect_retry_delay    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.default_floating_pool  = public {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.endpoint_override      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.extension_sync_interval = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.http_retries           = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.insecure               = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.keyfile                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.max_version            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.min_version            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.ovs_bridge             = br-int {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.physnets               = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.region_name            = RegionOne {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.service_metadata_proxy = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.service_name           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.service_type           = network {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.split_loggers          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.status_code_retries    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.timeout                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] neutron.version                = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] notifications.bdms_in_notifications = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] notifications.default_level    = INFO {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] notifications.notification_format = unversioned {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] notifications.notify_on_state_change = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] pci.alias                      = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] pci.device_spec                = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] pci.report_in_placement        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.auth_section         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.auth_type            = password {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.cafile               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.certfile             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.collect_timing       = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.connect_retries      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.connect_retry_delay  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.default_domain_id    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.default_domain_name  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.domain_id            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.domain_name          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.endpoint_override    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.insecure             = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.keyfile              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.max_version          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.min_version          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.password             = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.project_domain_id    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.project_domain_name  = Default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.project_id           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.project_name         = service {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.region_name          = RegionOne {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.service_name         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.service_type         = placement {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.split_loggers        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.status_code_retries  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.system_scope         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.timeout              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.trust_id             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.user_domain_id       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.user_domain_name     = Default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.user_id              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.username             = placement {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] placement.version              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.cores                    = 20 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.count_usage_from_placement = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.injected_file_content_bytes = 10240 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.injected_file_path_length = 255 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.injected_files           = 5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.instances                = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.key_pairs                = 100 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.metadata_items           = 128 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.ram                      = 51200 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.recheck_quota            = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.server_group_members     = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] quota.server_groups            = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rdp.enabled                    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.image_metadata_prefilter = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.max_attempts         = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.max_placement_results = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] scheduler.workers              = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.host_subset_size = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.isolated_hosts = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.isolated_images = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.pci_in_placement = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.track_instance_changes = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metrics.required               = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metrics.weight_multiplier      = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] metrics.weight_setting         = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.enabled         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.port_range      = 10000:20000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] serial_console.serialproxy_port = 6083 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.auth_section      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.auth_type         = password {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.cafile            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.certfile          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.collect_timing    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.insecure          = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.keyfile           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.send_service_user_token = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.split_loggers     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] service_user.timeout           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.agent_enabled            = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.enabled                  = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.html5proxy_port          = 6082 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.image_compression        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.jpeg_compression         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.playback_compression     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.server_listen            = 127.0.0.1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.streaming_mode           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] spice.zlib_compression         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] upgrade_levels.baseapi         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] upgrade_levels.compute         = auto {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] upgrade_levels.conductor       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] upgrade_levels.scheduler       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.cafile = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.certfile = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.insecure = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vendordata_dynamic_auth.timeout = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.api_retry_count         = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.ca_file                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.cache_prefix            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.cluster_name            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.connection_pool_size    = 10 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.console_delay_seconds   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.datastore_regex         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.host_ip                 = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.host_password           = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.host_port               = 443 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.host_username           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.insecure                = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.integration_bridge      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.maximum_objects         = 100 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.pbm_default_policy      = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.pbm_enabled             = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.pbm_wsdl_location       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.serial_port_proxy_uri   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.serial_port_service_uri = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.task_poll_interval      = 0.5 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.use_linked_clone        = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.vnc_keymap              = en-us {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.vnc_port                = 5900 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vmware.vnc_port_total          = 10000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.auth_schemes               = ['none'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.enabled                    = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.novncproxy_port            = 6080 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.vencrypt_ca_certs          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.vencrypt_client_cert       = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vnc.vencrypt_client_key        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.disable_rootwrap   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.enable_numa_live_migration = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.libvirt_disable_apic = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.client_socket_timeout     = 900 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.default_pool_size         = 1000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.keep_alive                = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.max_header_line           = 16384 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.ssl_ca_file               = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.ssl_cert_file             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.ssl_key_file              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.tcp_keepidle              = 600 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] zvm.ca_file                    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] zvm.cloud_connector_url        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] zvm.reachable_timeout          = 300 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.enforce_scope      = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.policy_default_rule = default {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.connection_string     = messaging:// {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.enabled               = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.es_doc_type           = notification {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.es_scroll_size        = 10000 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.es_scroll_time        = 2m {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.filter_error_trace    = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.hmac_keys             = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.sentinel_service_name = mymaster {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.socket_timeout        = 0.1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.trace_requests        = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler.trace_sqlalchemy      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler_jaeger.process_tags   = {} {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] profiler_otlp.service_name_prefix = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] remote_debug.host              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] remote_debug.port              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.auth_section        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.auth_type           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.cafile              = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.certfile            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.collect_timing      = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.connect_retries     = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.connect_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.endpoint_id         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.endpoint_override   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.insecure            = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.keyfile             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.max_version         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.min_version         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.region_name         = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.service_name        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.service_type        = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.split_loggers       = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.status_code_retries = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.status_code_retry_delay = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.timeout             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.valid_interfaces    = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_limit.version             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_reports.file_event_handler = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] oslo_reports.log_dir           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.group  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] vif_plug_ovs_privileged.user   = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.isolate_vif         = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] os_brick.lock_path             = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.capabilities   = [21] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.group          = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.helper_command = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] privsep_osbrick.user           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.group           = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.helper_command  = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] nova_sys_admin.user            = None {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG oslo_service.service [None req-e1d023e4-6073-42b5-9933-95537ce7b7b8 None None] ******************************************************************************** {{(pid=75266) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 00:37:10 user nova-compute[75266]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Connecting to libvirt: qemu:///system {{(pid=75266) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7badb5e3b0> {{(pid=75266) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 00:37:10 user nova-compute[75266]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 00:37:10 user nova-compute[75266]: WARNING nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7badb5e3b0> {{(pid=75266) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Starting native event thread {{(pid=75266) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Starting green dispatch thread {{(pid=75266) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Starting connection event dispatch thread {{(pid=75266) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 00:37:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Connection event '1' reason 'None'
Nov 28 00:37:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 00:37:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.mount [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Initialising _HostMountState generation 0 {{(pid=75266) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 00:37:17 user nova-compute[75266]: INFO nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host capabilities <capabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <host>
Nov 28 00:37:17 user nova-compute[75266]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 00:37:17 user nova-compute[75266]:     <cpu>
Nov 28 00:37:17 user nova-compute[75266]:       <arch>x86_64</arch>
Nov 28 00:37:17 user nova-compute[75266]:       <model>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <microcode version='1070'/>
Nov 28 00:37:17 user nova-compute[75266]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='osxsave'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='invtsc'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='rsba'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 00:37:17 user nova-compute[75266]:       <pages unit='KiB' size='4'/>
Nov 28 00:37:17 user nova-compute[75266]:       <pages unit='KiB' size='2048'/>
Nov 28 00:37:17 user nova-compute[75266]:     </cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <power_management>
Nov 28 00:37:17 user nova-compute[75266]:       <suspend_mem/>
Nov 28 00:37:17 user nova-compute[75266]:       <suspend_disk/>
Nov 28 00:37:17 user nova-compute[75266]:       <suspend_hybrid/>
Nov 28 00:37:17 user nova-compute[75266]:     </power_management>
Nov 28 00:37:17 user nova-compute[75266]:     <iommu support='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <migration_features>
Nov 28 00:37:17 user nova-compute[75266]:       <live/>
Nov 28 00:37:17 user nova-compute[75266]:       <uri_transports>
Nov 28 00:37:17 user nova-compute[75266]:         <uri_transport>tcp</uri_transport>
Nov 28 00:37:17 user nova-compute[75266]:         <uri_transport>rdma</uri_transport>
Nov 28 00:37:17 user nova-compute[75266]:       </uri_transports>
Nov 28 00:37:17 user nova-compute[75266]:     </migration_features>
Nov 28 00:37:17 user nova-compute[75266]:     <topology>
Nov 28 00:37:17 user nova-compute[75266]:       <cells num='2'>
Nov 28 00:37:17 user nova-compute[75266]:         <cell id='0'>
Nov 28 00:37:17 user nova-compute[75266]:           <memory unit='KiB'>8189224</memory>
Nov 28 00:37:17 user nova-compute[75266]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 28 00:37:17 user nova-compute[75266]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 00:37:17 user nova-compute[75266]:           <distances>
Nov 28 00:37:17 user nova-compute[75266]:             <sibling id='0' value='10'/>
Nov 28 00:37:17 user nova-compute[75266]:             <sibling id='1' value='20'/>
Nov 28 00:37:17 user nova-compute[75266]:           </distances>
Nov 28 00:37:17 user nova-compute[75266]:           <cpus num='6'>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 00:37:17 user nova-compute[75266]:           </cpus>
Nov 28 00:37:17 user nova-compute[75266]:         </cell>
Nov 28 00:37:17 user nova-compute[75266]:         <cell id='1'>
Nov 28 00:37:17 user nova-compute[75266]:           <memory unit='KiB'>8206460</memory>
Nov 28 00:37:17 user nova-compute[75266]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 28 00:37:17 user nova-compute[75266]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 00:37:17 user nova-compute[75266]:           <distances>
Nov 28 00:37:17 user nova-compute[75266]:             <sibling id='0' value='20'/>
Nov 28 00:37:17 user nova-compute[75266]:             <sibling id='1' value='10'/>
Nov 28 00:37:17 user nova-compute[75266]:           </distances>
Nov 28 00:37:17 user nova-compute[75266]:           <cpus num='6'>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 00:37:17 user nova-compute[75266]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 00:37:17 user nova-compute[75266]:           </cpus>
Nov 28 00:37:17 user nova-compute[75266]:         </cell>
Nov 28 00:37:17 user nova-compute[75266]:       </cells>
Nov 28 00:37:17 user nova-compute[75266]:     </topology>
Nov 28 00:37:17 user nova-compute[75266]:     <cache>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 00:37:17 user nova-compute[75266]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 00:37:17 user nova-compute[75266]:     </cache>
Nov 28 00:37:17 user nova-compute[75266]:     <secmodel>
Nov 28 00:37:17 user nova-compute[75266]:       <model>apparmor</model>
Nov 28 00:37:17 user nova-compute[75266]:       <doi>0</doi>
Nov 28 00:37:17 user nova-compute[75266]:     </secmodel>
Nov 28 00:37:17 user nova-compute[75266]:     <secmodel>
Nov 28 00:37:17 user nova-compute[75266]:       <model>dac</model>
Nov 28 00:37:17 user nova-compute[75266]:       <doi>0</doi>
Nov 28 00:37:17 user nova-compute[75266]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 00:37:17 user nova-compute[75266]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 00:37:17 user nova-compute[75266]:     </secmodel>
Nov 28 00:37:17 user nova-compute[75266]:   </host>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='alpha'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>clipper</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='armv6l'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>spitz</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>nuri</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>kzm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>z2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>tosa</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n810</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>terrier</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>midway</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>microbit</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>verdex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>highbank</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>akita</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>connex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>collie</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='armv7l'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>spitz</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>nuri</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>kzm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>z2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>tosa</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n810</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>terrier</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>midway</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>microbit</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>verdex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>highbank</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>akita</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>connex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>collie</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='aarch64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>spitz</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>nuri</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>kzm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>z2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>tosa</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n810</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>n800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>terrier</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>midway</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>microbit</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>verdex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>highbank</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>akita</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>connex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>collie</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <acpi default='on' toggle='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='cris'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='i686'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>isapc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>microvm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='kvm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <pae/>
Nov 28 00:37:17 user nova-compute[75266]:       <nonpae/>
Nov 28 00:37:17 user nova-compute[75266]:       <acpi default='on' toggle='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:       <apic default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='m68k'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>an5206</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>q800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='microblaze'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='microblazeel'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='mips'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>malta</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='mipsel'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>malta</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='mips64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>malta</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>pica61</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>magnum</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='mips64el'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>malta</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>pica61</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>magnum</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='16'>boston</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='ppc'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mac99</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>40p</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>taihu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='ppc64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>taihu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>40p</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mac99</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='ppc64le'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>taihu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>40p</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>mac99</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='riscv32'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='8'>spike</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='8'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='riscv64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='8'>spike</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='8'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='s390x'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='sh4'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>shix</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>r2d</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='sh4eb'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>shix</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>r2d</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='sparc'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>LX</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='sparc64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>niagara</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='x86_64'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>64</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='1'>isapc</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>microvm</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='kvm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <acpi default='on' toggle='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:       <apic default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='xtensa'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>sim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>kc705</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ml605</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx200</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx60</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]:   <guest>
Nov 28 00:37:17 user nova-compute[75266]:     <os_type>hvm</os_type>
Nov 28 00:37:17 user nova-compute[75266]:     <arch name='xtensaeb'>
Nov 28 00:37:17 user nova-compute[75266]:       <wordsize>32</wordsize>
Nov 28 00:37:17 user nova-compute[75266]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='4'>sim</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>kc705</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ml605</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>virt</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx200</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>lx60</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 00:37:17 user nova-compute[75266]:       <domain type='qemu'/>
Nov 28 00:37:17 user nova-compute[75266]:     </arch>
Nov 28 00:37:17 user nova-compute[75266]:     <features>
Nov 28 00:37:17 user nova-compute[75266]:       <cpuselection/>
Nov 28 00:37:17 user nova-compute[75266]:       <deviceboot/>
Nov 28 00:37:17 user nova-compute[75266]:       <disksnapshot default='on' toggle='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     </features>
Nov 28 00:37:17 user nova-compute[75266]:   </guest>
Nov 28 00:37:17 user nova-compute[75266]: </capabilities>
Nov 28 00:37:17 user nova-compute[75266]: 
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-q35-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>i686</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='288'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'/>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='lm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-i440fx-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>i686</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='255'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'/>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='lm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ide</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-q35-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>i686</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='288'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'/>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='lm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-i440fx-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>i686</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='255'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'/>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='lm'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ide</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-q35-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>x86_64</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='288'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>efi</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='invtsc'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='rsba'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-i440fx-6.2</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>x86_64</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='255'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>efi</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='invtsc'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='rsba'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ide</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-q35-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>x86_64</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='288'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>efi</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='invtsc'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='rsba'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 00:37:17 user nova-compute[75266]: <domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 00:37:17 user nova-compute[75266]:   <domain>kvm</domain>
Nov 28 00:37:17 user nova-compute[75266]:   <machine>pc-i440fx-jammy</machine>
Nov 28 00:37:17 user nova-compute[75266]:   <arch>x86_64</arch>
Nov 28 00:37:17 user nova-compute[75266]:   <vcpu max='255'/>
Nov 28 00:37:17 user nova-compute[75266]:   <iothreads supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:   <os supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='firmware'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>efi</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:     <loader supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>rom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pflash</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='readonly'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>yes</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='secure'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>no</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </loader>
Nov 28 00:37:17 user nova-compute[75266]:   </os>
Nov 28 00:37:17 user nova-compute[75266]:   <cpu>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-passthrough' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='hostPassthroughMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='maximum' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='maximumMigratable'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>on</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>off</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='host-model' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <vendor>Intel</vendor>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ss'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='vmx'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pcid'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='hypervisor'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arat'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='umip'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='md-clear'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='invtsc'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibpb'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='ibrs'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-stibp'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='rsba'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='erms'/>
Nov 28 00:37:17 user nova-compute[75266]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:     <mode name='custom' supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>qemu64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>qemu32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>phenom</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>pentium</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>n270</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm64</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>kvm32</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>coreduo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>core2duo</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>athlon</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Westmere</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Snowridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Skylake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>SandyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Penryn</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G5</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G4</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G3</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Opteron_G2</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Opteron_G1</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>IvyBridge</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Icelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Haswell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Rome</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-Milan</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>EPYC</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Dhyana</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cooperlake</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>Conroe</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='no'>Broadwell</model>
Nov 28 00:37:17 user nova-compute[75266]:       <model usable='yes'>486</model>
Nov 28 00:37:17 user nova-compute[75266]:     </mode>
Nov 28 00:37:17 user nova-compute[75266]:   </cpu>
Nov 28 00:37:17 user nova-compute[75266]:   <memoryBacking supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:     <enum name='sourceType'>
Nov 28 00:37:17 user nova-compute[75266]:       <value>file</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>anonymous</value>
Nov 28 00:37:17 user nova-compute[75266]:       <value>memfd</value>
Nov 28 00:37:17 user nova-compute[75266]:     </enum>
Nov 28 00:37:17 user nova-compute[75266]:   </memoryBacking>
Nov 28 00:37:17 user nova-compute[75266]:   <devices>
Nov 28 00:37:17 user nova-compute[75266]:     <disk supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='diskDevice'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>disk</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cdrom</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>floppy</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>lun</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='bus'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ide</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>fdc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sata</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </disk>
Nov 28 00:37:17 user nova-compute[75266]:     <graphics supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='type'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>sdl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vnc</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>spice</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egl-headless</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </graphics>
Nov 28 00:37:17 user nova-compute[75266]:     <video supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='modelType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>cirrus</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>vmvga</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>qxl</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>none</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>bochs</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>ramfb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </video>
Nov 28 00:37:17 user nova-compute[75266]:     <hostdev supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='mode'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>subsystem</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='startupPolicy'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>default</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>mandatory</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>requisite</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>optional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='subsysType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>usb</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>pci</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>scsi</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='capsType'/>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='pciBackend'/>
Nov 28 00:37:17 user nova-compute[75266]:     </hostdev>
Nov 28 00:37:17 user nova-compute[75266]:     <rng supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtio-non-transitional</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>random</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>egd</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>builtin</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </rng>
Nov 28 00:37:17 user nova-compute[75266]:     <filesystem supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='driverType'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>path</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>handle</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>virtiofs</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </filesystem>
Nov 28 00:37:17 user nova-compute[75266]:     <tpm supported='yes'>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='model'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-tis</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>tpm-crb</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:       <enum name='backendModel'>
Nov 28 00:37:17 user nova-compute[75266]:         <value>passthrough</value>
Nov 28 00:37:17 user nova-compute[75266]:         <value>emulator</value>
Nov 28 00:37:17 user nova-compute[75266]:       </enum>
Nov 28 00:37:17 user nova-compute[75266]:     </tpm>
Nov 28 00:37:17 user nova-compute[75266]:   </devices>
Nov 28 00:37:17 user nova-compute[75266]:   <features>
Nov 28 00:37:17 user nova-compute[75266]:     <gic supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:     <vmcoreinfo supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <genid supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backingStoreInput supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <backup supported='yes'/>
Nov 28 00:37:17 user nova-compute[75266]:     <sev supported='no'/>
Nov 28 00:37:17 user nova-compute[75266]:   </features>
Nov 28 00:37:17 user nova-compute[75266]: </domainCapabilities>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75266) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75266) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Checking secure boot support for host arch (x86_64) {{(pid=75266) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 00:37:17 user nova-compute[75266]: INFO nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Secure Boot support detected
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] cpu compare xml: <cpu match="exact">
Nov 28 00:37:17 user nova-compute[75266]:   <model>Nehalem</model>
Nov 28 00:37:17 user nova-compute[75266]: </cpu>
Nov 28 00:37:17 user nova-compute[75266]:  {{(pid=75266) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 00:37:17 user nova-compute[75266]: INFO nova.virt.node [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Generated node identity 6332c2c0-e5e9-4188-a49b-d53a0e699e47
Nov 28 00:37:17 user nova-compute[75266]: INFO nova.virt.node [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Wrote node identity 6332c2c0-e5e9-4188-a49b-d53a0e699e47 to /opt/stack/data/nova/compute_id
Nov 28 00:37:17 user nova-compute[75266]: WARNING nova.compute.manager [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Compute nodes ['6332c2c0-e5e9-4188-a49b-d53a0e699e47'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 00:37:17 user nova-compute[75266]: INFO nova.compute.manager [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 00:37:17 user nova-compute[75266]: WARNING nova.compute.manager [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 00:37:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:37:17 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:37:18 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:37:18 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Hypervisor/Node resource view: name=user free_ram=10975MB free_disk=26.118942260742188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:37:18 user nova-compute[75266]: WARNING nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] No compute node record for user:6332c2c0-e5e9-4188-a49b-d53a0e699e47: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6332c2c0-e5e9-4188-a49b-d53a0e699e47 could not be found.
Nov 28 00:37:18 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Compute node record created for user:user with uuid: 6332c2c0-e5e9-4188-a49b-d53a0e699e47
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:37:18 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] [req-1addd238-cb2c-45c5-b348-58daf33a9bd9] Created resource provider record via placement API for resource provider with UUID 6332c2c0-e5e9-4188-a49b-d53a0e699e47 and name user.
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75266) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 00:37:18 user nova-compute[75266]: INFO nova.virt.libvirt.host [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] kernel doesn't support AMD SEV
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Libvirt baseline CPU <cpu>
Nov 28 00:37:18 user nova-compute[75266]:   <arch>x86_64</arch>
Nov 28 00:37:18 user nova-compute[75266]:   <model>Nehalem</model>
Nov 28 00:37:18 user nova-compute[75266]:   <vendor>Intel</vendor>
Nov 28 00:37:18 user nova-compute[75266]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 00:37:18 user nova-compute[75266]: </cpu>
Nov 28 00:37:18 user nova-compute[75266]:  {{(pid=75266) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Updated inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Updating resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 generation from 0 to 1 during operation: update_inventory {{(pid=75266) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Updating resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 generation from 1 to 2 during operation: update_traits {{(pid=75266) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.service [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Creating RPC server for service compute {{(pid=75266) start /opt/stack/nova/nova/service.py:182}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.service [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] Join ServiceGroup membership for this service compute {{(pid=75266) start /opt/stack/nova/nova/service.py:199}}
Nov 28 00:37:18 user nova-compute[75266]: DEBUG nova.servicegroup.drivers.db [None req-10a46659-8ba3-4c04-af57-f44e7284cf85 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75266) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 00:38:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:38:09 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:38:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:38:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=10430MB free_disk=26.02261734008789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:38:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:39:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:39:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=26.08767318725586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:39:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:40:11 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:40:11 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:40:11 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=25.839435577392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:40:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:40:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:40:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:41:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:12 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:13 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:41:14 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:14 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9583MB free_disk=25.859954833984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:41:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:41:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:25 user nova-compute[75266]: INFO nova.compute.claims [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Claim successful on node user
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.284s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:25 user nova-compute[75266]: INFO nova.compute.claims [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Claim successful on node user
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Creating image(s)
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.663s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:25 user nova-compute[75266]: INFO nova.compute.claims [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Claim successful on node user
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.policy [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.policy [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Creating image(s)
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.virt.images [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 0eca691f-8ae7-4ede-a543-e4f526783da7 was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.part /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.768s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.943s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:26 user nova-compute[75266]: INFO nova.compute.claims [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Claim successful on node user
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.part /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.converted" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Creating image(s)
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "/opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.178s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe93nw4z9/privsep.sock']
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.500s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.053s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user sudo[84528]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe93nw4z9/privsep.sock
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.policy [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:27 user sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.092s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.compute.claims [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Claim successful on node user
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Creating image(s)
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Creating image(s)
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "/opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:27 user nova-compute[75266]: DEBUG nova.policy [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:28 user nova-compute[75266]: DEBUG nova.policy [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:28 user sudo[84528]: pam_unix(sudo:session): session closed for user root
Nov 28 00:41:28 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Spawned new privsep daemon via rootwrap
Nov 28 00:41:28 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 00:41:28 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 00:41:28 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 00:41:28 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84531
Nov 28 00:41:28 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] privsep daemon already running
Nov 28 00:41:28 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] privsep daemon already running
Nov 28 00:41:28 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] privsep daemon already running
Nov 28 00:41:28 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] privsep daemon already running
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Successfully created port: 5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Successfully created port: 598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.263s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.284s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Successfully created port: 178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.261s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Successfully created port: 625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk 1073741824" returned: 0 in 0.050s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.280s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.255s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk 1073741824" returned: 0 in 0.064s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.563s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Cannot resize image /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Ensure instance console log exists: /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.231s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk 1073741824" returned: 0 in 0.051s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.860s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Cannot resize image /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Ensure instance console log exists: /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.225s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk 1073741824" returned: 0 in 0.040s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.085s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Cannot resize image /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Ensure instance console log exists: /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.162s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.164s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk 1073741824" returned: 0 in 0.062s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.222s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Cannot resize image /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Ensure instance console log exists: /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Successfully created port: e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Successfully updated port: 5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Successfully updated port: 598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-changed-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Refreshing instance network info cache due to event network-changed-5d492cfb-25b6-4b28-b279-bd2f648c39f3. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Successfully updated port: 178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Successfully updated port: e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Successfully updated port: 625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance network_info: |[{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Refreshing network info cache for port 5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start _get_guest_xml network_info=[{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-368791726',display_name='tempest-ServerRescueNegativeTestJSON-server-368791726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-368791726',id=2,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-v0cnts0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:26Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=bf245d26-e901-4fca-8ff5-a3558974294b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing instance network info cache due to event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:34 user nova-compute[75266]:   <uuid>bf245d26-e901-4fca-8ff5-a3558974294b</uuid>
Nov 28 00:41:34 user nova-compute[75266]:   <name>instance-00000002</name>
Nov 28 00:41:34 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:34 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:34 user nova-compute[75266]:   <metadata>
Nov 28 00:41:34 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:34 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-368791726</nova:name>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:34</nova:creationTime>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:34 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:port uuid="5d492cfb-25b6-4b28-b279-bd2f648c39f3">
Nov 28 00:41:34 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 00:41:34 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:34 user nova-compute[75266]:   </metadata>
Nov 28 00:41:34 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:34 user nova-compute[75266]:     <system>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="serial">bf245d26-e901-4fca-8ff5-a3558974294b</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="uuid">bf245d26-e901-4fca-8ff5-a3558974294b</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:34 user nova-compute[75266]:     </system>
Nov 28 00:41:34 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:34 user nova-compute[75266]:   <os>
Nov 28 00:41:34 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:34 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:34 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:34 user nova-compute[75266]:   </os>
Nov 28 00:41:34 user nova-compute[75266]:   <features>
Nov 28 00:41:34 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:34 user nova-compute[75266]:     <apic/>
Nov 28 00:41:34 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:34 user nova-compute[75266]:   </features>
Nov 28 00:41:34 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:34 user nova-compute[75266]:   </clock>
Nov 28 00:41:34 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:34 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:34 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:34 user nova-compute[75266]:   </cpu>
Nov 28 00:41:34 user nova-compute[75266]:   <devices>
Nov 28 00:41:34 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:34 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:34 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </disk>
Nov 28 00:41:34 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:34 user nova-compute[75266]:       <mac address="fa:16:3e:f4:e8:58"/>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="tap5d492cfb-25"/>
Nov 28 00:41:34 user nova-compute[75266]:     </interface>
Nov 28 00:41:34 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:34 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/console.log" append="off"/>
Nov 28 00:41:34 user nova-compute[75266]:     </serial>
Nov 28 00:41:34 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:     <video>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </video>
Nov 28 00:41:34 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:34 user nova-compute[75266]:     </rng>
Nov 28 00:41:34 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:34 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:34 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:34 user nova-compute[75266]:   </devices>
Nov 28 00:41:34 user nova-compute[75266]: </domain>
Nov 28 00:41:34 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-368791726',display_name='tempest-ServerRescueNegativeTestJSON-server-368791726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-368791726',id=2,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-v0cnts0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:26Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=bf245d26-e901-4fca-8ff5-a3558974294b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG os_vif [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Created schema index Interface.name {{(pid=75266) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Created schema index Port.name {{(pid=75266) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Created schema index Bridge.name {{(pid=75266) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [POLLOUT] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddbc67f0-0da7-5773-a7e1-7896de559307', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:34 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp0wff_13z/privsep.sock']
Nov 28 00:41:34 user sudo[84617]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp0wff_13z/privsep.sock
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-changed-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Refreshing instance network info cache due to event network-changed-625efbe6-4ffa-44c8-90e8-3bb69f390dbb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Acquiring lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:34 user sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance network_info: |[{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start _get_guest_xml network_info=[{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:34 user nova-compute[75266]:   <uuid>6f7c5378-aadc-45e4-b3c3-d308e526b03a</uuid>
Nov 28 00:41:34 user nova-compute[75266]:   <name>instance-00000001</name>
Nov 28 00:41:34 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:34 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:34 user nova-compute[75266]:   <metadata>
Nov 28 00:41:34 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:34 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeTestJSON-server-1318610697</nova:name>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:34</nova:creationTime>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:34 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:user uuid="7cf2b106f48442cd84784a5880737464">tempest-AttachVolumeTestJSON-1794071981-project-member</nova:user>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:project uuid="7cf38cc0048d41bfb69a50d55f9c1963">tempest-AttachVolumeTestJSON-1794071981</nova:project>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:port uuid="598b9806-e561-4d8b-9e33-1e8ec1268b48">
Nov 28 00:41:34 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:41:34 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:34 user nova-compute[75266]:   </metadata>
Nov 28 00:41:34 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:34 user nova-compute[75266]:     <system>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="serial">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="uuid">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:34 user nova-compute[75266]:     </system>
Nov 28 00:41:34 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:34 user nova-compute[75266]:   <os>
Nov 28 00:41:34 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:34 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:34 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:34 user nova-compute[75266]:   </os>
Nov 28 00:41:34 user nova-compute[75266]:   <features>
Nov 28 00:41:34 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:34 user nova-compute[75266]:     <apic/>
Nov 28 00:41:34 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:34 user nova-compute[75266]:   </features>
Nov 28 00:41:34 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:34 user nova-compute[75266]:   </clock>
Nov 28 00:41:34 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:34 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:34 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:34 user nova-compute[75266]:   </cpu>
Nov 28 00:41:34 user nova-compute[75266]:   <devices>
Nov 28 00:41:34 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:34 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:34 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </disk>
Nov 28 00:41:34 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:34 user nova-compute[75266]:       <mac address="fa:16:3e:6b:f5:56"/>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="tap598b9806-e5"/>
Nov 28 00:41:34 user nova-compute[75266]:     </interface>
Nov 28 00:41:34 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:34 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/console.log" append="off"/>
Nov 28 00:41:34 user nova-compute[75266]:     </serial>
Nov 28 00:41:34 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:     <video>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </video>
Nov 28 00:41:34 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:34 user nova-compute[75266]:     </rng>
Nov 28 00:41:34 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:34 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:34 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:34 user nova-compute[75266]:   </devices>
Nov 28 00:41:34 user nova-compute[75266]: </domain>
Nov 28 00:41:34 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG os_vif [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b266ed-4f88-5a41-82d7-d5e0d9261db0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Instance network_info: |[{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Start _get_guest_xml network_info=[{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963073311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963073311',id=3,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-9datddi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:27Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=55113bea-793b-4d9f-a897-f6f7eb261079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid 55113bea-793b-4d9f-a897-f6f7eb261079 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:34 user nova-compute[75266]:   <uuid>55113bea-793b-4d9f-a897-f6f7eb261079</uuid>
Nov 28 00:41:34 user nova-compute[75266]:   <name>instance-00000003</name>
Nov 28 00:41:34 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:34 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:34 user nova-compute[75266]:   <metadata>
Nov 28 00:41:34 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:34 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-963073311</nova:name>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:34</nova:creationTime>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:34 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:34 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:         <nova:port uuid="178ea9e9-90f7-4fce-a4eb-a1d90ad483ed">
Nov 28 00:41:34 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:41:34 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:34 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:34 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:34 user nova-compute[75266]:   </metadata>
Nov 28 00:41:34 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:34 user nova-compute[75266]:     <system>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="serial">55113bea-793b-4d9f-a897-f6f7eb261079</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="uuid">55113bea-793b-4d9f-a897-f6f7eb261079</entry>
Nov 28 00:41:34 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:34 user nova-compute[75266]:     </system>
Nov 28 00:41:34 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:34 user nova-compute[75266]:   <os>
Nov 28 00:41:34 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:34 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:34 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:34 user nova-compute[75266]:   </os>
Nov 28 00:41:34 user nova-compute[75266]:   <features>
Nov 28 00:41:34 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:34 user nova-compute[75266]:     <apic/>
Nov 28 00:41:34 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:34 user nova-compute[75266]:   </features>
Nov 28 00:41:34 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:34 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:34 user nova-compute[75266]:   </clock>
Nov 28 00:41:34 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:34 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:34 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:34 user nova-compute[75266]:   </cpu>
Nov 28 00:41:34 user nova-compute[75266]:   <devices>
Nov 28 00:41:34 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:34 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:34 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </disk>
Nov 28 00:41:34 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:34 user nova-compute[75266]:       <mac address="fa:16:3e:01:64:6c"/>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:34 user nova-compute[75266]:       <target dev="tap178ea9e9-90"/>
Nov 28 00:41:34 user nova-compute[75266]:     </interface>
Nov 28 00:41:34 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:34 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/console.log" append="off"/>
Nov 28 00:41:34 user nova-compute[75266]:     </serial>
Nov 28 00:41:34 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:34 user nova-compute[75266]:     <video>
Nov 28 00:41:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:34 user nova-compute[75266]:     </video>
Nov 28 00:41:34 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:34 user nova-compute[75266]:     </rng>
Nov 28 00:41:34 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:34 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:34 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:34 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:34 user nova-compute[75266]:   </devices>
Nov 28 00:41:34 user nova-compute[75266]: </domain>
Nov 28 00:41:34 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963073311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963073311',id=3,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-9datddi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:27Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=55113bea-793b-4d9f-a897-f6f7eb261079,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG os_vif [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44ca3b59-4243-59ab-bed9-bfc3d4afe7c7', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-changed-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Refreshing instance network info cache due to event network-changed-598b9806-e561-4d8b-9e33-1e8ec1268b48. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Refreshing network info cache for port 598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Instance network_info: |[{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Start _get_guest_xml network_info=[{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1516510796',display_name='tempest-ServerActionsTestOtherA-server-1516510796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1516510796',id=5,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-5kd1km50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=19151248-a33d-46b2-be99-0a85a5ab88d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'pci_devices' on Instance uuid 19151248-a33d-46b2-be99-0a85a5ab88d3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:35 user nova-compute[75266]:   <uuid>19151248-a33d-46b2-be99-0a85a5ab88d3</uuid>
Nov 28 00:41:35 user nova-compute[75266]:   <name>instance-00000005</name>
Nov 28 00:41:35 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:35 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:35 user nova-compute[75266]:   <metadata>
Nov 28 00:41:35 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:35 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherA-server-1516510796</nova:name>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:35</nova:creationTime>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:35 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:user uuid="f63a0e9261934c8b8e673f069c3376bd">tempest-ServerActionsTestOtherA-277302336-project-member</nova:user>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:project uuid="22c31829ff0846fc8584d492bea6cdc4">tempest-ServerActionsTestOtherA-277302336</nova:project>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:port uuid="e6fc4f41-e0f9-4d3e-9361-e29c116e19ef">
Nov 28 00:41:35 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 00:41:35 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:35 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:35 user nova-compute[75266]:   </metadata>
Nov 28 00:41:35 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:35 user nova-compute[75266]:     <system>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="serial">19151248-a33d-46b2-be99-0a85a5ab88d3</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="uuid">19151248-a33d-46b2-be99-0a85a5ab88d3</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:35 user nova-compute[75266]:     </system>
Nov 28 00:41:35 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:35 user nova-compute[75266]:   <os>
Nov 28 00:41:35 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:35 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:35 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:35 user nova-compute[75266]:   </os>
Nov 28 00:41:35 user nova-compute[75266]:   <features>
Nov 28 00:41:35 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:35 user nova-compute[75266]:     <apic/>
Nov 28 00:41:35 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:35 user nova-compute[75266]:   </features>
Nov 28 00:41:35 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:35 user nova-compute[75266]:   </clock>
Nov 28 00:41:35 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:35 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:35 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:35 user nova-compute[75266]:   </cpu>
Nov 28 00:41:35 user nova-compute[75266]:   <devices>
Nov 28 00:41:35 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:35 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:35 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk"/>
Nov 28 00:41:35 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:     </disk>
Nov 28 00:41:35 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:35 user nova-compute[75266]:       <mac address="fa:16:3e:bf:a9:5a"/>
Nov 28 00:41:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:35 user nova-compute[75266]:       <target dev="tape6fc4f41-e0"/>
Nov 28 00:41:35 user nova-compute[75266]:     </interface>
Nov 28 00:41:35 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:35 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/console.log" append="off"/>
Nov 28 00:41:35 user nova-compute[75266]:     </serial>
Nov 28 00:41:35 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:35 user nova-compute[75266]:     <video>
Nov 28 00:41:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:     </video>
Nov 28 00:41:35 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:35 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:35 user nova-compute[75266]:     </rng>
Nov 28 00:41:35 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:35 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:35 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:35 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:35 user nova-compute[75266]:   </devices>
Nov 28 00:41:35 user nova-compute[75266]: </domain>
Nov 28 00:41:35 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1516510796',display_name='tempest-ServerActionsTestOtherA-server-1516510796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1516510796',id=5,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-5kd1km50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=19151248-a33d-46b2-be99-0a85a5ab88d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG os_vif [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa64aca6-35ed-5b1f-ad21-46a53f3cda7e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance network_info: |[{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Acquired lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Refreshing network info cache for port 625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start _get_guest_xml network_info=[{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1646530713',display_name='tempest-ServerRescueNegativeTestJSON-server-1646530713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1646530713',id=4,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-k0f7b6ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:27Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=3f32bed1-593f-4bf4-ba26-9496d83fc17f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:35 user nova-compute[75266]:   <uuid>3f32bed1-593f-4bf4-ba26-9496d83fc17f</uuid>
Nov 28 00:41:35 user nova-compute[75266]:   <name>instance-00000004</name>
Nov 28 00:41:35 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:35 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:35 user nova-compute[75266]:   <metadata>
Nov 28 00:41:35 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:35 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1646530713</nova:name>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:35</nova:creationTime>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:35 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:35 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:35 user nova-compute[75266]:         <nova:port uuid="625efbe6-4ffa-44c8-90e8-3bb69f390dbb">
Nov 28 00:41:35 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:41:35 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:35 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:35 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:35 user nova-compute[75266]:   </metadata>
Nov 28 00:41:35 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:35 user nova-compute[75266]:     <system>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="serial">3f32bed1-593f-4bf4-ba26-9496d83fc17f</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="uuid">3f32bed1-593f-4bf4-ba26-9496d83fc17f</entry>
Nov 28 00:41:35 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:35 user nova-compute[75266]:     </system>
Nov 28 00:41:35 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:35 user nova-compute[75266]:   <os>
Nov 28 00:41:35 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:35 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:35 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:35 user nova-compute[75266]:   </os>
Nov 28 00:41:35 user nova-compute[75266]:   <features>
Nov 28 00:41:35 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:35 user nova-compute[75266]:     <apic/>
Nov 28 00:41:35 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:35 user nova-compute[75266]:   </features>
Nov 28 00:41:35 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:35 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:35 user nova-compute[75266]:   </clock>
Nov 28 00:41:35 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:35 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:35 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:35 user nova-compute[75266]:   </cpu>
Nov 28 00:41:35 user nova-compute[75266]:   <devices>
Nov 28 00:41:35 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:35 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:35 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk"/>
Nov 28 00:41:35 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:     </disk>
Nov 28 00:41:35 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:35 user nova-compute[75266]:       <mac address="fa:16:3e:12:2a:2f"/>
Nov 28 00:41:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:35 user nova-compute[75266]:       <target dev="tap625efbe6-4f"/>
Nov 28 00:41:35 user nova-compute[75266]:     </interface>
Nov 28 00:41:35 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:35 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/console.log" append="off"/>
Nov 28 00:41:35 user nova-compute[75266]:     </serial>
Nov 28 00:41:35 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:35 user nova-compute[75266]:     <video>
Nov 28 00:41:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:35 user nova-compute[75266]:     </video>
Nov 28 00:41:35 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:35 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:35 user nova-compute[75266]:     </rng>
Nov 28 00:41:35 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:35 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:35 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:35 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:35 user nova-compute[75266]:   </devices>
Nov 28 00:41:35 user nova-compute[75266]: </domain>
Nov 28 00:41:35 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1646530713',display_name='tempest-ServerRescueNegativeTestJSON-server-1646530713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1646530713',id=4,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-k0f7b6ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:27Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=3f32bed1-593f-4bf4-ba26-9496d83fc17f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG os_vif [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '941c4cee-ff4d-504d-a305-1cf010373519', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updated VIF entry in instance network info cache for port 5d492cfb-25b6-4b28-b279-bd2f648c39f3. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:35 user sudo[84617]: pam_unix(sudo:session): session closed for user root
Nov 28 00:41:35 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Spawned new privsep daemon via rootwrap
Nov 28 00:41:35 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 00:41:35 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 00:41:35 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 00:41:35 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84629
Nov 28 00:41:36 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] privsep daemon already running
Nov 28 00:41:36 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] privsep daemon already running
Nov 28 00:41:36 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] privsep daemon already running
Nov 28 00:41:36 user nova-compute[75266]: WARNING oslo_privsep.priv_context [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] privsep daemon already running
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updated VIF entry in instance network info cache for port 598b9806-e561-4d8b-9e33-1e8ec1268b48. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-changed-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Refreshing instance network info cache due to event network-changed-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Acquiring lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Acquired lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Refreshing network info cache for port 178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap178ea9e9-90, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap178ea9e9-90, col_values=(('qos', UUID('60d9cf87-7f7a-40ff-a408-bdd021635347')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap178ea9e9-90, col_values=(('external_ids', {'iface-id': '178ea9e9-90f7-4fce-a4eb-a1d90ad483ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:64:6c', 'vm-uuid': '55113bea-793b-4d9f-a897-f6f7eb261079'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: INFO os_vif [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90')
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap625efbe6-4f, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap625efbe6-4f, col_values=(('qos', UUID('8abaae7b-4649-4d0d-a070-9a8b836c9594')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap625efbe6-4f, col_values=(('external_ids', {'iface-id': '625efbe6-4ffa-44c8-90e8-3bb69f390dbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:2a:2f', 'vm-uuid': '3f32bed1-593f-4bf4-ba26-9496d83fc17f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: INFO os_vif [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f')
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598b9806-e5, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap598b9806-e5, col_values=(('qos', UUID('54e7fc78-e963-410b-a46b-bb03640bd5a0')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap598b9806-e5, col_values=(('external_ids', {'iface-id': '598b9806-e561-4d8b-9e33-1e8ec1268b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f5:56', 'vm-uuid': '6f7c5378-aadc-45e4-b3c3-d308e526b03a'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: INFO os_vif [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated VIF entry in instance network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d492cfb-25, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d492cfb-25, col_values=(('qos', UUID('098d0b83-557a-4cbe-b74b-e7603e323308')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d492cfb-25, col_values=(('external_ids', {'iface-id': '5d492cfb-25b6-4b28-b279-bd2f648c39f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:e8:58', 'vm-uuid': 'bf245d26-e901-4fca-8ff5-a3558974294b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: INFO os_vif [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25')
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6fc4f41-e0, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6fc4f41-e0, col_values=(('qos', UUID('827a1920-0d90-4b32-91d0-de97522faba2')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6fc4f41-e0, col_values=(('external_ids', {'iface-id': 'e6fc4f41-e0f9-4d3e-9361-e29c116e19ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a9:5a', 'vm-uuid': '19151248-a33d-46b2-be99-0a85a5ab88d3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:01:64:6c, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updated VIF entry in instance network info cache for port 625efbe6-4ffa-44c8-90e8-3bb69f390dbb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:12:2a:2f, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Releasing lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:36 user nova-compute[75266]: INFO os_vif [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0')
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No VIF found with MAC fa:16:3e:6b:f5:56, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:f4:e8:58, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:bf:a9:5a, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:37 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updated VIF entry in instance network info cache for port 178ea9e9-90f7-4fce-a4eb-a1d90ad483ed. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:37 user nova-compute[75266]: DEBUG nova.network.neutron [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Releasing lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.claims [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Claim successful on node user
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance spawned successfully.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance spawned successfully.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance spawned successfully.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Instance spawned successfully.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Took 20.78 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Instance spawned successfully.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Took 18.90 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Took 19.23 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Took 20.29 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Took 21.80 seconds to build instance.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:46 user nova-compute[75266]: INFO nova.compute.manager [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Took 19.89 seconds to build instance.
Nov 28 00:41:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.028s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.compute.manager [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Took 21.33 seconds to build instance.
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 5.702s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.compute.manager [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Took 21.95 seconds to build instance.
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.124s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.169s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.564s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Took 20.14 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.compute.manager [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Took 22.21 seconds to build instance.
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.376s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.policy [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:47 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Creating image(s)
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "/opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "/opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.326s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.285s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk 1073741824" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.469s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.249s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Cannot resize image /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Ensure instance console log exists: /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Successfully created port: 7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Successfully updated port: 7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquired lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-changed-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Refreshing instance network info cache due to event network-changed-7b8ba726-9082-4459-86ba-f4317c342dbe. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Acquiring lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:51 user nova-compute[75266]: INFO nova.compute.claims [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Claim successful on node user
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating instance_info_cache with network_info: [{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.431s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:52 user nova-compute[75266]: INFO nova.compute.claims [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Claim successful on node user
Nov 28 00:41:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Releasing lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Instance network_info: |[{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Acquired lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Refreshing network info cache for port 7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Start _get_guest_xml network_info=[{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1834749863',display_name='tempest-VolumesAdminNegativeTest-server-1834749863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1834749863',id=6,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmhSe4yt2zgpFuLSEaBNMFCfQEO+QSmraG+pYRtdpblrmCGO6mV7MPaD+lQDdSMsHI6o6aUzPYUDsWwGXKodtKN0zw3FGkAKn1th/bUwX4t22USh80iUUJSHJ67JruAZA==',key_name='tempest-keypair-2094337696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-9t0lpu0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6657488fa71b469c954276af7717308e',uuid=6f443cac-7a1c-49d2-9ed1-79a13883688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:52 user nova-compute[75266]:   <uuid>6f443cac-7a1c-49d2-9ed1-79a13883688a</uuid>
Nov 28 00:41:52 user nova-compute[75266]:   <name>instance-00000006</name>
Nov 28 00:41:52 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:52 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:52 user nova-compute[75266]:   <metadata>
Nov 28 00:41:52 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:52 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1834749863</nova:name>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:52</nova:creationTime>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:52 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:52 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:user uuid="6657488fa71b469c954276af7717308e">tempest-VolumesAdminNegativeTest-119723273-project-member</nova:user>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:project uuid="ea1afcbb4b3643c5ae366c8e39f3d8ed">tempest-VolumesAdminNegativeTest-119723273</nova:project>
Nov 28 00:41:52 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:52 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:52 user nova-compute[75266]:         <nova:port uuid="7b8ba726-9082-4459-86ba-f4317c342dbe">
Nov 28 00:41:52 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:41:52 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:52 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:52 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:52 user nova-compute[75266]:   </metadata>
Nov 28 00:41:52 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:52 user nova-compute[75266]:     <system>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="serial">6f443cac-7a1c-49d2-9ed1-79a13883688a</entry>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="uuid">6f443cac-7a1c-49d2-9ed1-79a13883688a</entry>
Nov 28 00:41:52 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:52 user nova-compute[75266]:     </system>
Nov 28 00:41:52 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:52 user nova-compute[75266]:   <os>
Nov 28 00:41:52 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:52 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:52 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:52 user nova-compute[75266]:   </os>
Nov 28 00:41:52 user nova-compute[75266]:   <features>
Nov 28 00:41:52 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:52 user nova-compute[75266]:     <apic/>
Nov 28 00:41:52 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:52 user nova-compute[75266]:   </features>
Nov 28 00:41:52 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:52 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:52 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:52 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:52 user nova-compute[75266]:   </clock>
Nov 28 00:41:52 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:52 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:52 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:52 user nova-compute[75266]:   </cpu>
Nov 28 00:41:52 user nova-compute[75266]:   <devices>
Nov 28 00:41:52 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:52 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:52 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk"/>
Nov 28 00:41:52 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:52 user nova-compute[75266]:     </disk>
Nov 28 00:41:52 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:52 user nova-compute[75266]:       <mac address="fa:16:3e:03:99:69"/>
Nov 28 00:41:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:52 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:52 user nova-compute[75266]:       <target dev="tap7b8ba726-90"/>
Nov 28 00:41:52 user nova-compute[75266]:     </interface>
Nov 28 00:41:52 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:52 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/console.log" append="off"/>
Nov 28 00:41:52 user nova-compute[75266]:     </serial>
Nov 28 00:41:52 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:52 user nova-compute[75266]:     <video>
Nov 28 00:41:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:52 user nova-compute[75266]:     </video>
Nov 28 00:41:52 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:52 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:52 user nova-compute[75266]:     </rng>
Nov 28 00:41:52 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:52 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:52 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:52 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:52 user nova-compute[75266]:   </devices>
Nov 28 00:41:52 user nova-compute[75266]: </domain>
Nov 28 00:41:52 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1834749863',display_name='tempest-VolumesAdminNegativeTest-server-1834749863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1834749863',id=6,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmhSe4yt2zgpFuLSEaBNMFCfQEO+QSmraG+pYRtdpblrmCGO6mV7MPaD+lQDdSMsHI6o6aUzPYUDsWwGXKodtKN0zw3FGkAKn1th/bUwX4t22USh80iUUJSHJ67JruAZA==',key_name='tempest-keypair-2094337696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-9t0lpu0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6657488fa71b469c954276af7717308e',uuid=6f443cac-7a1c-49d2-9ed1-79a13883688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG os_vif [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b97dc14-e590-5e9d-a28b-1d56aba16fdf', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b8ba726-90, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b8ba726-90, col_values=(('qos', UUID('74d794f3-c5ff-4b1e-9ffd-91734bf2c6e9')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b8ba726-90, col_values=(('external_ids', {'iface-id': '7b8ba726-9082-4459-86ba-f4317c342dbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:99:69', 'vm-uuid': '6f443cac-7a1c-49d2-9ed1-79a13883688a'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:53 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:53 user nova-compute[75266]: INFO os_vif [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90')
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No VIF found with MAC fa:16:3e:03:99:69, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.policy [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36df2251d9194760adcbdb9bf70ba341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616d5666496446ce828fde8a3dd0380b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:53 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Creating image(s)
Nov 28 00:41:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "7a77957f66666c43b161b69529db97d8fd05a5ba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "7a77957f66666c43b161b69529db97d8fd05a5ba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updated VIF entry in instance network info cache for port 7b8ba726-9082-4459-86ba-f4317c342dbe. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating instance_info_cache with network_info: [{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.part --force-share --output=json" returned: 0 in 0.295s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.virt.images [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 6e30adb9-4060-4751-85b1-4631c7e5b7c4 was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.part /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Releasing lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.762s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:41:54 user nova-compute[75266]: INFO nova.compute.claims [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Claim successful on node user
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Successfully created port: f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.part /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.converted" returned: 0 in 0.322s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.policy [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "7a77957f66666c43b161b69529db97d8fd05a5ba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.579s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:55 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Creating image(s)
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json" returned: 0 in 0.474s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "7a77957f66666c43b161b69529db97d8fd05a5ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "7a77957f66666c43b161b69529db97d8fd05a5ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] No waiting events found dispatching network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:41:55 user nova-compute[75266]: WARNING nova.compute.manager [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received unexpected event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe for instance with vm_state building and task_state spawning.
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.614s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.259s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json" returned: 0 in 0.396s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba,backing_fmt=raw /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba,backing_fmt=raw /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk 1073741824" returned: 0 in 0.147s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "7a77957f66666c43b161b69529db97d8fd05a5ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.550s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.399s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk 1073741824" returned: 0 in 0.099s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.505s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:41:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Creating image(s)
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "/opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "/opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "/opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.policy [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4107c4de40db41478617a3e7740cdaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcf25cb4d7643beaf41d08d65c37c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba --force-share --output=json" returned: 0 in 0.450s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.304s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Successfully created port: 734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.251s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Cannot resize image /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Ensure instance console log exists: /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Successfully updated port: f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.386s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Cannot resize image /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Ensure instance console log exists: /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquired lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-changed-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Refreshing instance network info cache due to event network-changed-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Acquiring lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.271s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk 1073741824" returned: 0 in 0.511s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.788s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] No waiting events found dispatching network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:41:57 user nova-compute[75266]: WARNING nova.compute.manager [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received unexpected event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe for instance with vm_state building and task_state spawning.
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.440s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Successfully created port: d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating instance_info_cache with network_info: [{"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Releasing lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Instance network_info: |[{"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Acquired lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Refreshing network info cache for port f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Start _get_guest_xml network_info=[{"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:41:42Z,direct_url=<?>,disk_format='qcow2',id=6e30adb9-4060-4751-85b1-4631c7e5b7c4,min_disk=0,min_ram=0,name='',owner='bcccfdd07ef04976b586f4c7d4b5e61a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:41:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/sda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '6e30adb9-4060-4751-85b1-4631c7e5b7c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:41:42Z,direct_url=<?>,disk_format='qcow2',id=6e30adb9-4060-4751-85b1-4631c7e5b7c4,min_disk=0,min_ram=0,name='',owner='bcccfdd07ef04976b586f4c7d4b5e61a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:41:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-293684211',display_name='tempest-AttachSCSIVolumeTestJSON-server-293684211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-293684211',id=7,image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwnHKx+PiTEI0wUrFbf6lAcmNgFJf1sB96KFPtN1nsQLvuUpSP+zMzvsEQu60Iu8aCR66g+RaiF1f/PKfGhvzPotEZvGPkQ6i3IIL05YARIE+yLueZIgKDKP+kerp2PnA==',key_name='tempest-keypair-1026390778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='616d5666496446ce828fde8a3dd0380b',ramdisk_id='',reservation_id='r-6bgcpecb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1035698266',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1035698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36df2251d9194760adcbdb9bf70ba341',uuid=b8080c31-0df3-44ba-8586-b1ca39d9c97e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converting VIF {"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'pci_devices' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.549s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:58 user nova-compute[75266]:   <uuid>b8080c31-0df3-44ba-8586-b1ca39d9c97e</uuid>
Nov 28 00:41:58 user nova-compute[75266]:   <name>instance-00000007</name>
Nov 28 00:41:58 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:58 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:58 user nova-compute[75266]:   <metadata>
Nov 28 00:41:58 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:58 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-293684211</nova:name>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:58</nova:creationTime>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:58 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:58 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:user uuid="36df2251d9194760adcbdb9bf70ba341">tempest-AttachSCSIVolumeTestJSON-1035698266-project-member</nova:user>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:project uuid="616d5666496446ce828fde8a3dd0380b">tempest-AttachSCSIVolumeTestJSON-1035698266</nova:project>
Nov 28 00:41:58 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:root type="image" uuid="6e30adb9-4060-4751-85b1-4631c7e5b7c4"/>
Nov 28 00:41:58 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:58 user nova-compute[75266]:         <nova:port uuid="f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c">
Nov 28 00:41:58 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 00:41:58 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:58 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:58 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:58 user nova-compute[75266]:   </metadata>
Nov 28 00:41:58 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:58 user nova-compute[75266]:     <system>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="serial">b8080c31-0df3-44ba-8586-b1ca39d9c97e</entry>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="uuid">b8080c31-0df3-44ba-8586-b1ca39d9c97e</entry>
Nov 28 00:41:58 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:58 user nova-compute[75266]:     </system>
Nov 28 00:41:58 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:58 user nova-compute[75266]:   <os>
Nov 28 00:41:58 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:58 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:58 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:58 user nova-compute[75266]:   </os>
Nov 28 00:41:58 user nova-compute[75266]:   <features>
Nov 28 00:41:58 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:58 user nova-compute[75266]:     <apic/>
Nov 28 00:41:58 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:58 user nova-compute[75266]:   </features>
Nov 28 00:41:58 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:58 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:58 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:58 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:58 user nova-compute[75266]:   </clock>
Nov 28 00:41:58 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:58 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:58 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:58 user nova-compute[75266]:   </cpu>
Nov 28 00:41:58 user nova-compute[75266]:   <devices>
Nov 28 00:41:58 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:58 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:58 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk"/>
Nov 28 00:41:58 user nova-compute[75266]:       <target dev="sda" bus="scsi"/>
Nov 28 00:41:58 user nova-compute[75266]:       <address type="drive" controller="0" unit="0"/>
Nov 28 00:41:58 user nova-compute[75266]:     </disk>
Nov 28 00:41:58 user nova-compute[75266]:     <disk type="file" device="cdrom">
Nov 28 00:41:58 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 00:41:58 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.config"/>
Nov 28 00:41:58 user nova-compute[75266]:       <target dev="sdb" bus="scsi"/>
Nov 28 00:41:58 user nova-compute[75266]:       <address type="drive" controller="0" unit="1"/>
Nov 28 00:41:58 user nova-compute[75266]:     </disk>
Nov 28 00:41:58 user nova-compute[75266]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 00:41:58 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:58 user nova-compute[75266]:       <mac address="fa:16:3e:ac:9b:f4"/>
Nov 28 00:41:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:58 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:58 user nova-compute[75266]:       <target dev="tapf9537aa9-c3"/>
Nov 28 00:41:58 user nova-compute[75266]:     </interface>
Nov 28 00:41:58 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:58 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/console.log" append="off"/>
Nov 28 00:41:58 user nova-compute[75266]:     </serial>
Nov 28 00:41:58 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:58 user nova-compute[75266]:     <video>
Nov 28 00:41:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:58 user nova-compute[75266]:     </video>
Nov 28 00:41:58 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:58 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:58 user nova-compute[75266]:     </rng>
Nov 28 00:41:58 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:58 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:58 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:58 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:58 user nova-compute[75266]:   </devices>
Nov 28 00:41:58 user nova-compute[75266]: </domain>
Nov 28 00:41:58 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-293684211',display_name='tempest-AttachSCSIVolumeTestJSON-server-293684211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-293684211',id=7,image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwnHKx+PiTEI0wUrFbf6lAcmNgFJf1sB96KFPtN1nsQLvuUpSP+zMzvsEQu60Iu8aCR66g+RaiF1f/PKfGhvzPotEZvGPkQ6i3IIL05YARIE+yLueZIgKDKP+kerp2PnA==',key_name='tempest-keypair-1026390778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='616d5666496446ce828fde8a3dd0380b',ramdisk_id='',reservation_id='r-6bgcpecb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1035698266',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1035698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36df2251d9194760adcbdb9bf70ba341',uuid=b8080c31-0df3-44ba-8586-b1ca39d9c97e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converting VIF {"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG os_vif [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Cannot resize image /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Ensure instance console log exists: /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81aeeb66-5869-5970-8556-22d163f3cefc', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9537aa9-c3, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9537aa9-c3, col_values=(('qos', UUID('098ff460-8f02-45a0-855e-bf2832612a79')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9537aa9-c3, col_values=(('external_ids', {'iface-id': 'f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9b:f4', 'vm-uuid': 'b8080c31-0df3-44ba-8586-b1ca39d9c97e'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Successfully updated port: 734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:58 user nova-compute[75266]: INFO os_vif [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3')
Nov 28 00:41:58 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Instance spawned successfully.
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-changed-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing instance network info cache due to event network-changed-734679ea-803f-454c-ad23-ed3bbd4951e5. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No BDM found with device name sda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No VIF found with MAC fa:16:3e:ac:9b:f4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:41:58 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Using config drive
Nov 28 00:41:58 user nova-compute[75266]: INFO nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Took 11.32 seconds to spawn the instance on the hypervisor.
Nov 28 00:41:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:41:59 user nova-compute[75266]: INFO nova.compute.manager [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Took 17.77 seconds to build instance.
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.940s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Successfully updated port: d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquired lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updated VIF entry in instance network info cache for port f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating instance_info_cache with network_info: [{"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Releasing lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-changed-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Refreshing instance network info cache due to event network-changed-d958f7e8-8730-4756-8515-ce61c1d1efce. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Acquiring lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Instance network_info: |[{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing network info cache for port 734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Start _get_guest_xml network_info=[{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:41:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'pci_devices' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:41:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Creating config drive at /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.config
Nov 28 00:41:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0u5sx390 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:41:59 user nova-compute[75266]:   <uuid>86575409-89de-4408-a573-d069767ebb15</uuid>
Nov 28 00:41:59 user nova-compute[75266]:   <name>instance-00000008</name>
Nov 28 00:41:59 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:41:59 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:41:59 user nova-compute[75266]:   <metadata>
Nov 28 00:41:59 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:41:59 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:41:59</nova:creationTime>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:41:59 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:41:59 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:owner>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:41:59 user nova-compute[75266]:       </nova:owner>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:41:59 user nova-compute[75266]:       <nova:ports>
Nov 28 00:41:59 user nova-compute[75266]:         <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:41:59 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:41:59 user nova-compute[75266]:         </nova:port>
Nov 28 00:41:59 user nova-compute[75266]:       </nova:ports>
Nov 28 00:41:59 user nova-compute[75266]:     </nova:instance>
Nov 28 00:41:59 user nova-compute[75266]:   </metadata>
Nov 28 00:41:59 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:41:59 user nova-compute[75266]:     <system>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="serial">86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="uuid">86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:41:59 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:41:59 user nova-compute[75266]:     </system>
Nov 28 00:41:59 user nova-compute[75266]:   </sysinfo>
Nov 28 00:41:59 user nova-compute[75266]:   <os>
Nov 28 00:41:59 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:41:59 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:41:59 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:41:59 user nova-compute[75266]:   </os>
Nov 28 00:41:59 user nova-compute[75266]:   <features>
Nov 28 00:41:59 user nova-compute[75266]:     <acpi/>
Nov 28 00:41:59 user nova-compute[75266]:     <apic/>
Nov 28 00:41:59 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:41:59 user nova-compute[75266]:   </features>
Nov 28 00:41:59 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:41:59 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:41:59 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:41:59 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:41:59 user nova-compute[75266]:   </clock>
Nov 28 00:41:59 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:41:59 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:41:59 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:41:59 user nova-compute[75266]:   </cpu>
Nov 28 00:41:59 user nova-compute[75266]:   <devices>
Nov 28 00:41:59 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:41:59 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:41:59 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk"/>
Nov 28 00:41:59 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:41:59 user nova-compute[75266]:     </disk>
Nov 28 00:41:59 user nova-compute[75266]:     <disk type="file" device="cdrom">
Nov 28 00:41:59 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 00:41:59 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config"/>
Nov 28 00:41:59 user nova-compute[75266]:       <target dev="hda" bus="ide"/>
Nov 28 00:41:59 user nova-compute[75266]:     </disk>
Nov 28 00:41:59 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:41:59 user nova-compute[75266]:       <mac address="fa:16:3e:bb:af:f2"/>
Nov 28 00:41:59 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:59 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:41:59 user nova-compute[75266]:       <target dev="tap734679ea-80"/>
Nov 28 00:41:59 user nova-compute[75266]:     </interface>
Nov 28 00:41:59 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:41:59 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log" append="off"/>
Nov 28 00:41:59 user nova-compute[75266]:     </serial>
Nov 28 00:41:59 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:41:59 user nova-compute[75266]:     <video>
Nov 28 00:41:59 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:41:59 user nova-compute[75266]:     </video>
Nov 28 00:41:59 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:41:59 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:41:59 user nova-compute[75266]:     </rng>
Nov 28 00:41:59 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:41:59 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:41:59 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:41:59 user nova-compute[75266]:     </memballoon>
Nov 28 00:41:59 user nova-compute[75266]:   </devices>
Nov 28 00:41:59 user nova-compute[75266]: </domain>
Nov 28 00:41:59 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG os_vif [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a07fb91-182d-574b-bd4b-321f4751a635', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:41:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap734679ea-80, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap734679ea-80, col_values=(('qos', UUID('8ba40d3a-31e0-4375-87e2-dcc9e3f01e7e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap734679ea-80, col_values=(('external_ids', {'iface-id': '734679ea-803f-454c-ad23-ed3bbd4951e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:af:f2', 'vm-uuid': '86575409-89de-4408-a573-d069767ebb15'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0u5sx390" returned: 0 in 0.210s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: INFO os_vif [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80')
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating instance_info_cache with network_info: [{"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Releasing lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Instance network_info: |[{"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Acquired lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.neutron [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Refreshing network info cache for port d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Start _get_guest_xml network_info=[{"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name hda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No VIF found with MAC fa:16:3e:bb:af:f2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:42:00 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Using config drive
Nov 28 00:42:00 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:00 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-255438338',display_name='tempest-TestVolumeSwap-server-255438338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-255438338',id=9,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI8v8L4f2bUuyj5OhUmhozUp13Ks3fEXRi3Oj6qTZkdAZBJ96CVn6kUw9HpfFZZCCphg/vMW3teFNC6XQPhuvhYhd7IKUXYFQ+6Z9SU6vXSbWsXURJpVx1JUUK/fwm46Q==',key_name='tempest-keypair-7931677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcf25cb4d7643beaf41d08d65c37c76',ramdisk_id='',reservation_id='r-274gfgv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-792541960',owner_user_name='tempest-TestVolumeSwap-792541960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107c4de40db41478617a3e7740cdaf2',uuid=46fb5677-018f-4e32-b945-166600ec6a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converting VIF {"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'pci_devices' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:42:00 user nova-compute[75266]:   <uuid>46fb5677-018f-4e32-b945-166600ec6a24</uuid>
Nov 28 00:42:00 user nova-compute[75266]:   <name>instance-00000009</name>
Nov 28 00:42:00 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:42:00 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:42:00 user nova-compute[75266]:   <metadata>
Nov 28 00:42:00 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:42:00 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:name>tempest-TestVolumeSwap-server-255438338</nova:name>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:42:00</nova:creationTime>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:42:00 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:42:00 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:owner>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:user uuid="4107c4de40db41478617a3e7740cdaf2">tempest-TestVolumeSwap-792541960-project-member</nova:user>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:project uuid="bfcf25cb4d7643beaf41d08d65c37c76">tempest-TestVolumeSwap-792541960</nova:project>
Nov 28 00:42:00 user nova-compute[75266]:       </nova:owner>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:42:00 user nova-compute[75266]:       <nova:ports>
Nov 28 00:42:00 user nova-compute[75266]:         <nova:port uuid="d958f7e8-8730-4756-8515-ce61c1d1efce">
Nov 28 00:42:00 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 00:42:00 user nova-compute[75266]:         </nova:port>
Nov 28 00:42:00 user nova-compute[75266]:       </nova:ports>
Nov 28 00:42:00 user nova-compute[75266]:     </nova:instance>
Nov 28 00:42:00 user nova-compute[75266]:   </metadata>
Nov 28 00:42:00 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:42:00 user nova-compute[75266]:     <system>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="serial">46fb5677-018f-4e32-b945-166600ec6a24</entry>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="uuid">46fb5677-018f-4e32-b945-166600ec6a24</entry>
Nov 28 00:42:00 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:42:00 user nova-compute[75266]:     </system>
Nov 28 00:42:00 user nova-compute[75266]:   </sysinfo>
Nov 28 00:42:00 user nova-compute[75266]:   <os>
Nov 28 00:42:00 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:42:00 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:42:00 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:42:00 user nova-compute[75266]:   </os>
Nov 28 00:42:00 user nova-compute[75266]:   <features>
Nov 28 00:42:00 user nova-compute[75266]:     <acpi/>
Nov 28 00:42:00 user nova-compute[75266]:     <apic/>
Nov 28 00:42:00 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:42:00 user nova-compute[75266]:   </features>
Nov 28 00:42:00 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:42:00 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:42:00 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:42:00 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:42:00 user nova-compute[75266]:   </clock>
Nov 28 00:42:00 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:42:00 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:42:00 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:42:00 user nova-compute[75266]:   </cpu>
Nov 28 00:42:00 user nova-compute[75266]:   <devices>
Nov 28 00:42:00 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:42:00 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:42:00 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk"/>
Nov 28 00:42:00 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:42:00 user nova-compute[75266]:     </disk>
Nov 28 00:42:00 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:42:00 user nova-compute[75266]:       <mac address="fa:16:3e:28:53:e2"/>
Nov 28 00:42:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:42:00 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:42:00 user nova-compute[75266]:       <target dev="tapd958f7e8-87"/>
Nov 28 00:42:00 user nova-compute[75266]:     </interface>
Nov 28 00:42:00 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:42:00 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/console.log" append="off"/>
Nov 28 00:42:00 user nova-compute[75266]:     </serial>
Nov 28 00:42:00 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:42:00 user nova-compute[75266]:     <video>
Nov 28 00:42:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:42:00 user nova-compute[75266]:     </video>
Nov 28 00:42:00 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:42:00 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:42:00 user nova-compute[75266]:     </rng>
Nov 28 00:42:00 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:42:00 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:42:00 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:42:00 user nova-compute[75266]:     </memballoon>
Nov 28 00:42:00 user nova-compute[75266]:   </devices>
Nov 28 00:42:00 user nova-compute[75266]: </domain>
Nov 28 00:42:00 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-255438338',display_name='tempest-TestVolumeSwap-server-255438338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-255438338',id=9,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI8v8L4f2bUuyj5OhUmhozUp13Ks3fEXRi3Oj6qTZkdAZBJ96CVn6kUw9HpfFZZCCphg/vMW3teFNC6XQPhuvhYhd7IKUXYFQ+6Z9SU6vXSbWsXURJpVx1JUUK/fwm46Q==',key_name='tempest-keypair-7931677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfcf25cb4d7643beaf41d08d65c37c76',ramdisk_id='',reservation_id='r-274gfgv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-792541960',owner_user_name='tempest-TestVolumeSwap-792541960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107c4de40db41478617a3e7740cdaf2',uuid=46fb5677-018f-4e32-b945-166600ec6a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converting VIF {"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG os_vif [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91ff193d-1f18-5895-b094-3c23a21a1c42', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd958f7e8-87, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd958f7e8-87, col_values=(('qos', UUID('502f4a7d-cf91-48e5-97ab-fd87493bc68e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd958f7e8-87, col_values=(('external_ids', {'iface-id': 'd958f7e8-8730-4756-8515-ce61c1d1efce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:53:e2', 'vm-uuid': '46fb5677-018f-4e32-b945-166600ec6a24'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:00 user nova-compute[75266]: INFO os_vif [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87')
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] No VIF found with MAC fa:16:3e:28:53:e2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:42:00 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Creating config drive at /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config
Nov 28 00:42:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp51xj2vpj {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.neutron [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updated VIF entry in instance network info cache for port 734679ea-803f-454c-ad23-ed3bbd4951e5. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG nova.network.neutron [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp51xj2vpj" returned: 0 in 0.070s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updated VIF entry in instance network info cache for port d958f7e8-8730-4756-8515-ce61c1d1efce. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:42:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating instance_info_cache with network_info: [{"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Releasing lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:42:02 user nova-compute[75266]: INFO nova.compute.claims [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Claim successful on node user
Nov 28 00:42:02 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:42:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.policy [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '764878c5fd98438193043f4a5e812442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ed4d4553b4460ca8688714e6d7c335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:42:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Creating image(s)
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "/opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "/opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.269s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk 1073741824" returned: 0 in 0.111s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Successfully created port: cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.230s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.416s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Cannot resize image /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Ensure instance console log exists: /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:04 user nova-compute[75266]: WARNING nova.compute.manager [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state None.
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Successfully updated port: cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquired lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-changed-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Refreshing instance network info cache due to event network-changed-cd82c939-7f4c-4114-97c2-9a4f166d9e23. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Acquiring lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] No waiting events found dispatching network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:06 user nova-compute[75266]: WARNING nova.compute.manager [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received unexpected event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance with vm_state active and task_state None.
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:06 user nova-compute[75266]: WARNING nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state None.
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:06 user nova-compute[75266]: WARNING nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state None.
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:06 user nova-compute[75266]: WARNING nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state None.
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:06 user nova-compute[75266]: WARNING nova.compute.manager [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state active and task_state None.
Nov 28 00:42:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating instance_info_cache with network_info: [{"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Releasing lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Instance network_info: |[{"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Acquired lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Refreshing network info cache for port cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Start _get_guest_xml network_info=[{"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:42:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042329240',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042329240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042329240',id=10,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvTiY4dxQAb9LsYRO0lskk9ck/WkedyunqgTAhqwxwkQxob6pmFUtvNK0PLIropmLdelwefawXtUbFkAj07J8tGnQxdvzeSVHovmSM6IobjeCc2WsqnQKXobXN3gL+AtQ==',key_name='tempest-keypair-120630317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47ed4d4553b4460ca8688714e6d7c335',ramdisk_id='',reservation_id='r-ok41bpzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1497464835',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1497464835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='764878c5fd98438193043f4a5e812442',uuid=fdea5f7d-ce77-4c66-afac-ddc24baeabd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converting VIF {"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lazy-loading 'pci_devices' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:42:07 user nova-compute[75266]:   <uuid>fdea5f7d-ce77-4c66-afac-ddc24baeabd9</uuid>
Nov 28 00:42:07 user nova-compute[75266]:   <name>instance-0000000a</name>
Nov 28 00:42:07 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:42:07 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:42:07 user nova-compute[75266]:   <metadata>
Nov 28 00:42:07 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:42:07 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2042329240</nova:name>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:42:07</nova:creationTime>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:42:07 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:42:07 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:owner>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:user uuid="764878c5fd98438193043f4a5e812442">tempest-VolumesAssistedSnapshotsTest-1497464835-project-member</nova:user>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:project uuid="47ed4d4553b4460ca8688714e6d7c335">tempest-VolumesAssistedSnapshotsTest-1497464835</nova:project>
Nov 28 00:42:07 user nova-compute[75266]:       </nova:owner>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:42:07 user nova-compute[75266]:       <nova:ports>
Nov 28 00:42:07 user nova-compute[75266]:         <nova:port uuid="cd82c939-7f4c-4114-97c2-9a4f166d9e23">
Nov 28 00:42:07 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:42:07 user nova-compute[75266]:         </nova:port>
Nov 28 00:42:07 user nova-compute[75266]:       </nova:ports>
Nov 28 00:42:07 user nova-compute[75266]:     </nova:instance>
Nov 28 00:42:07 user nova-compute[75266]:   </metadata>
Nov 28 00:42:07 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:42:07 user nova-compute[75266]:     <system>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="serial">fdea5f7d-ce77-4c66-afac-ddc24baeabd9</entry>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="uuid">fdea5f7d-ce77-4c66-afac-ddc24baeabd9</entry>
Nov 28 00:42:07 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:42:07 user nova-compute[75266]:     </system>
Nov 28 00:42:07 user nova-compute[75266]:   </sysinfo>
Nov 28 00:42:07 user nova-compute[75266]:   <os>
Nov 28 00:42:07 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:42:07 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:42:07 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:42:07 user nova-compute[75266]:   </os>
Nov 28 00:42:07 user nova-compute[75266]:   <features>
Nov 28 00:42:07 user nova-compute[75266]:     <acpi/>
Nov 28 00:42:07 user nova-compute[75266]:     <apic/>
Nov 28 00:42:07 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:42:07 user nova-compute[75266]:   </features>
Nov 28 00:42:07 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:42:07 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:42:07 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:42:07 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:42:07 user nova-compute[75266]:   </clock>
Nov 28 00:42:07 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:42:07 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:42:07 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:42:07 user nova-compute[75266]:   </cpu>
Nov 28 00:42:07 user nova-compute[75266]:   <devices>
Nov 28 00:42:07 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:42:07 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:42:07 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk"/>
Nov 28 00:42:07 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:42:07 user nova-compute[75266]:     </disk>
Nov 28 00:42:07 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:42:07 user nova-compute[75266]:       <mac address="fa:16:3e:f8:1a:64"/>
Nov 28 00:42:07 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:42:07 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:42:07 user nova-compute[75266]:       <target dev="tapcd82c939-7f"/>
Nov 28 00:42:07 user nova-compute[75266]:     </interface>
Nov 28 00:42:07 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:42:07 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/console.log" append="off"/>
Nov 28 00:42:07 user nova-compute[75266]:     </serial>
Nov 28 00:42:07 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:42:07 user nova-compute[75266]:     <video>
Nov 28 00:42:07 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:42:07 user nova-compute[75266]:     </video>
Nov 28 00:42:07 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:42:07 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:42:07 user nova-compute[75266]:     </rng>
Nov 28 00:42:07 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:42:07 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:42:07 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:42:07 user nova-compute[75266]:     </memballoon>
Nov 28 00:42:07 user nova-compute[75266]:   </devices>
Nov 28 00:42:07 user nova-compute[75266]: </domain>
Nov 28 00:42:07 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042329240',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042329240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042329240',id=10,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvTiY4dxQAb9LsYRO0lskk9ck/WkedyunqgTAhqwxwkQxob6pmFUtvNK0PLIropmLdelwefawXtUbFkAj07J8tGnQxdvzeSVHovmSM6IobjeCc2WsqnQKXobXN3gL+AtQ==',key_name='tempest-keypair-120630317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47ed4d4553b4460ca8688714e6d7c335',ramdisk_id='',reservation_id='r-ok41bpzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1497464835',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1497464835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='764878c5fd98438193043f4a5e812442',uuid=fdea5f7d-ce77-4c66-afac-ddc24baeabd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converting VIF {"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG os_vif [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2698e174-b197-50fc-824c-194c46fd6853', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd82c939-7f, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd82c939-7f, col_values=(('qos', UUID('2bcfb15b-74fa-489c-a44e-a2d0b6de22c3')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd82c939-7f, col_values=(('external_ids', {'iface-id': 'cd82c939-7f4c-4114-97c2-9a4f166d9e23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:1a:64', 'vm-uuid': 'fdea5f7d-ce77-4c66-afac-ddc24baeabd9'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:07 user nova-compute[75266]: INFO os_vif [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f')
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] No VIF found with MAC fa:16:3e:f8:1a:64, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.neutron [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updated VIF entry in instance network info cache for port cd82c939-7f4c-4114-97c2-9a4f166d9e23. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.network.neutron [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating instance_info_cache with network_info: [{"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Releasing lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:07 user nova-compute[75266]: WARNING nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 for instance with vm_state building and task_state spawning.
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:07 user nova-compute[75266]: WARNING nova.compute.manager [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 for instance with vm_state building and task_state spawning.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] No waiting events found dispatching network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received unexpected event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance with vm_state active and task_state None.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state active and task_state None.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state active and task_state None.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state active and task_state None.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] No waiting events found dispatching network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received unexpected event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce for instance with vm_state building and task_state spawning.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] No waiting events found dispatching network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received unexpected event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce for instance with vm_state building and task_state spawning.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] No waiting events found dispatching network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received unexpected event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance with vm_state building and task_state spawning.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] No waiting events found dispatching network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:08 user nova-compute[75266]: WARNING nova.compute.manager [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received unexpected event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance with vm_state building and task_state spawning.
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 86575409-89de-4408-a573-d069767ebb15] Instance spawned successfully.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Took 14.42 seconds to spawn the instance on the hypervisor.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Instance spawned successfully.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Instance spawned successfully.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Took 13.26 seconds to spawn the instance on the hypervisor.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Took 17.56 seconds to build instance.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.780s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Took 16.41 seconds to spawn the instance on the hypervisor.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Took 15.37 seconds to build instance.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.706s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:09 user nova-compute[75266]: INFO nova.compute.manager [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Took 18.20 seconds to build instance.
Nov 28 00:42:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.377s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] No waiting events found dispatching network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:10 user nova-compute[75266]: WARNING nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received unexpected event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance with vm_state building and task_state spawning.
Nov 28 00:42:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] No waiting events found dispatching network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:42:10 user nova-compute[75266]: WARNING nova.compute.manager [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received unexpected event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance with vm_state building and task_state spawning.
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:42:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Instance spawned successfully.
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:42:11 user nova-compute[75266]: INFO nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Took 8.48 seconds to spawn the instance on the hypervisor.
Nov 28 00:42:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:42:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:11 user nova-compute[75266]: INFO nova.compute.manager [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Took 9.57 seconds to build instance.
Nov 28 00:42:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.715s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:13 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:42:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.388s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.476s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.396s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=25.590072631835938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 86575409-89de-4408-a573-d069767ebb15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 46fb5677-018f-4e32-b945-166600ec6a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 00:42:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 00:42:21 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:42:21 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:42:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:42:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.947s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:42:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:42:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:42:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:42:42 user nova-compute[75266]: INFO nova.compute.claims [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Claim successful on node user
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:42:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:42:43 user nova-compute[75266]: INFO nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Booting with volume 52865390-32c6-476c-b67a-61116319990f at /dev/vda
Nov 28 00:42:43 user nova-compute[75266]: DEBUG nova.policy [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:42:43 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:42:43 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpi46ic43z/privsep.sock']
Nov 28 00:42:43 user sudo[86529]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpi46ic43z/privsep.sock
Nov 28 00:42:43 user sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 00:42:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully created port: b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully created port: 93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:45 user sudo[86529]: pam_unix(sudo:session): session closed for user root
Nov 28 00:42:45 user nova-compute[75266]: INFO oslo.privsep.daemon [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Spawned new privsep daemon via rootwrap
Nov 28 00:42:45 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 00:42:45 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 00:42:45 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 00:42:45 user nova-compute[75266]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86532
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c224a-f61c-46de-9827-0d0ef60e8792]: (2,) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully created port: f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e994a7-6aca-4277-8c65-22e8aee0ff60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: WARNING os_brick.initiator.connectors.nvmeof [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e17cad-0486-46c6-b993-9d9ca4275dde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d95c61-ca51-4a0a-bd7c-6d2e2f577d97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0513b2-e6e7-4108-afae-666d623284f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:42:45 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:42:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ecd1a-be64-44e3-9b25-9bdd2f62ee65]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== get_connector_properties: return (1870ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:42:45 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating existing volume attachment record: 66aa608f-dade-4be2-91ff-7282efc2e570 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:42:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully created port: 6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully created port: c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-b4b1bb66-214e-4774-96ca-91634121b5d5. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: 03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: 12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-03619394-6a6e-497d-b570-4a288cdcd6f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port 03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: 93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-12d80f85-36dc-495d-9e2a-47ccaeafe267. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port 12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: 6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-93942af8-6733-4aa8-ab7a-6306b5196f30. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port 93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Successfully updated port: c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-f6ea4af3-eb88-4c03-a3bf-c852a8464e52. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-6b322b03-7a4e-4a72-8a3d-3cc3a485f801. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port 6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:42:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:42:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:42:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-c986d58d-26af-42f2-b152-4e31e6403c2c. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:42:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:42:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance network_info: |[{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:42:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:42:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:42:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updated VIF entry in instance network info cache for port c986d58d-26af-42f2-b152-4e31e6403c2c. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:42:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:42:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:42:56 user nova-compute[75266]: INFO nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Booting with volume 6685b5b0-ebeb-4499-80de-9a81996811db at /dev/vdb
Nov 28 00:42:56 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b4cfa-1548-4fc1-9764-057d819de83b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6007f-2c5d-4441-87fc-04b345a6e25a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e6304-f548-4dcd-866f-e9b40f5f2dea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525bb15-f3c6-4bab-ae61-7b5f9d134927]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:42:57 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:42:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489ac15-20b2-4c45-8ca1-9fe35f29724f]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating existing volume attachment record: a1c79b54-249a-44c8-9ae7-fc5c64e13ea3 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:42:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:04 user nova-compute[75266]: INFO nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Booting with volume 2b6b19a4-9b37-451a-a517-92a140e6c9f4 at /dev/vdc
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[654d4b43-aa6e-4690-a500-8824f6d0fc93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1781e-43fd-4ef8-8ef0-a8c7f6345bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b8c0e6-6e92-43fd-942b-4a765e815aa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c6315-7550-4201-a34d-83089ce68809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:04 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4b783-5d77-47ee-ad72-efe274bfd08f]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG os_brick.utils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:04 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating existing volume attachment record: 9da99649-e01d-4015-882c-7c7d28256469 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:43:06 user nova-compute[75266]: INFO nova.compute.claims [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Claim successful on node user
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:43:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:43:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.policy [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:43:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Creating image(s)
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "/opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "/opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "/opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk 1073741824" returned: 0 in 0.060s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Successfully created port: 8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.227s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:43:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Cannot resize image /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Ensure instance console log exists: /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Successfully updated port: 8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquired lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-changed-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Refreshing instance network info cache due to event network-changed-8482d7a1-9b99-461b-aff7-9748c14d2529. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Acquiring lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updating instance_info_cache with network_info: [{"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Releasing lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Instance network_info: |[{"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Acquired lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.neutron [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Refreshing network info cache for port 8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Start _get_guest_xml network_info=[{"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:43:08 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:08 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1773137',id=12,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDV9oRV1wyim0sPI9SAlyevLGDgoxJX4WmEfY5ypsISajiixGHb150bg76nB7Ak8q1IJt+UTv38X7TheRdTKeSv00fCBixae2T3atzjMnCzv6q0GKf0tAXto0fhbm1Yaw==',key_name='tempest-keypair-867180318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a97779a519d04d8bb60a0dfcfd23f347',ramdisk_id='',reservation_id='r-u29ylxvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6f5f016eeb4e1fbb54d8b4163a1e69',uuid=2619f610-3a3c-4b48-9448-c30d75414e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converting VIF {"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'pci_devices' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:43:08 user nova-compute[75266]:   <uuid>2619f610-3a3c-4b48-9448-c30d75414e56</uuid>
Nov 28 00:43:08 user nova-compute[75266]:   <name>instance-0000000c</name>
Nov 28 00:43:08 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:43:08 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:43:08 user nova-compute[75266]:   <metadata>
Nov 28 00:43:08 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:43:08 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725</nova:name>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:43:08</nova:creationTime>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:43:08 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:43:08 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:owner>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:user uuid="9c6f5f016eeb4e1fbb54d8b4163a1e69">tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member</nova:user>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:project uuid="a97779a519d04d8bb60a0dfcfd23f347">tempest-TestServerVolumeAttachScenarioOldVersion-1833316421</nova:project>
Nov 28 00:43:08 user nova-compute[75266]:       </nova:owner>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:43:08 user nova-compute[75266]:       <nova:ports>
Nov 28 00:43:08 user nova-compute[75266]:         <nova:port uuid="8482d7a1-9b99-461b-aff7-9748c14d2529">
Nov 28 00:43:08 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:43:08 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:08 user nova-compute[75266]:       </nova:ports>
Nov 28 00:43:08 user nova-compute[75266]:     </nova:instance>
Nov 28 00:43:08 user nova-compute[75266]:   </metadata>
Nov 28 00:43:08 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:43:08 user nova-compute[75266]:     <system>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="serial">2619f610-3a3c-4b48-9448-c30d75414e56</entry>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="uuid">2619f610-3a3c-4b48-9448-c30d75414e56</entry>
Nov 28 00:43:08 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:43:08 user nova-compute[75266]:     </system>
Nov 28 00:43:08 user nova-compute[75266]:   </sysinfo>
Nov 28 00:43:08 user nova-compute[75266]:   <os>
Nov 28 00:43:08 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:43:08 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:43:08 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:43:08 user nova-compute[75266]:   </os>
Nov 28 00:43:08 user nova-compute[75266]:   <features>
Nov 28 00:43:08 user nova-compute[75266]:     <acpi/>
Nov 28 00:43:08 user nova-compute[75266]:     <apic/>
Nov 28 00:43:08 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:43:08 user nova-compute[75266]:   </features>
Nov 28 00:43:08 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:43:08 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:43:08 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:43:08 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:43:08 user nova-compute[75266]:   </clock>
Nov 28 00:43:08 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:43:08 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:43:08 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:43:08 user nova-compute[75266]:   </cpu>
Nov 28 00:43:08 user nova-compute[75266]:   <devices>
Nov 28 00:43:08 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:43:08 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:43:08 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk"/>
Nov 28 00:43:08 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:43:08 user nova-compute[75266]:     </disk>
Nov 28 00:43:08 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:08 user nova-compute[75266]:       <mac address="fa:16:3e:a4:e6:b7"/>
Nov 28 00:43:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:08 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:08 user nova-compute[75266]:       <target dev="tap8482d7a1-9b"/>
Nov 28 00:43:08 user nova-compute[75266]:     </interface>
Nov 28 00:43:08 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:43:08 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/console.log" append="off"/>
Nov 28 00:43:08 user nova-compute[75266]:     </serial>
Nov 28 00:43:08 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:43:08 user nova-compute[75266]:     <video>
Nov 28 00:43:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:08 user nova-compute[75266]:     </video>
Nov 28 00:43:08 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:43:08 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:43:08 user nova-compute[75266]:     </rng>
Nov 28 00:43:08 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:43:08 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:43:08 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:43:08 user nova-compute[75266]:     </memballoon>
Nov 28 00:43:08 user nova-compute[75266]:   </devices>
Nov 28 00:43:08 user nova-compute[75266]: </domain>
Nov 28 00:43:08 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1773137',id=12,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDV9oRV1wyim0sPI9SAlyevLGDgoxJX4WmEfY5ypsISajiixGHb150bg76nB7Ak8q1IJt+UTv38X7TheRdTKeSv00fCBixae2T3atzjMnCzv6q0GKf0tAXto0fhbm1Yaw==',key_name='tempest-keypair-867180318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a97779a519d04d8bb60a0dfcfd23f347',ramdisk_id='',reservation_id='r-u29ylxvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6f5f016eeb4e1fbb54d8b4163a1e69',uuid=2619f610-3a3c-4b48-9448-c30d75414e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converting VIF {"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG os_vif [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02db1d39-fac0-5c0d-824c-7326050d73c0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8482d7a1-9b, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8482d7a1-9b, col_values=(('qos', UUID('151da299-6ff6-4206-be40-5e39ea49cc7e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8482d7a1-9b, col_values=(('external_ids', {'iface-id': '8482d7a1-9b99-461b-aff7-9748c14d2529', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:e6:b7', 'vm-uuid': '2619f610-3a3c-4b48-9448-c30d75414e56'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:08 user nova-compute[75266]: INFO os_vif [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b')
Nov 28 00:43:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] No VIF found with MAC fa:16:3e:a4:e6:b7, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:09 user nova-compute[75266]: DEBUG nova.network.neutron [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updated VIF entry in instance network info cache for port 8482d7a1-9b99-461b-aff7-9748c14d2529. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:09 user nova-compute[75266]: DEBUG nova.network.neutron [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updating instance_info_cache with network_info: [{"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Releasing lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] No waiting events found dispatching network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:10 user nova-compute[75266]: WARNING nova.compute.manager [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received unexpected event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 for instance with vm_state building and task_state spawning.
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:43:10 user nova-compute[75266]: INFO nova.compute.claims [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Claim successful on node user
Nov 28 00:43:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:43:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.policy [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f853e07c209544cf88d39ad0a2f3a694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f78eaf469545e2ba9232811de8e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:43:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Creating image(s)
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "/opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "/opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:43:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Creating image(s)
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Ensure instance console log exists: /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Start _get_guest_xml network_info=[{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjGNHuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51a4dd5e-3313-4c04-a699-9184465e9895', 'attached_at': '', 'detached_at': '', 'volume_id': '52865390-32c6-476c-b67a-61116319990f', 'serial': '52865390-32c6-476c-b67a-61116319990f'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '66aa608f-dade-4be2-91ff-7282efc2e570', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkojhOIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51a4dd5e-3313-4c04-a699-9184465e9895', 'attached_at': '', 'detached_at': '', 'volume_id': '6685b5b0-ebeb-4499-80de-9a81996811db', 'serial': '6685b5b0-ebeb-4499-80de-9a81996811db'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a1c79b54-249a-44c8-9ae7-fc5c64e13ea3', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNgKcIGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51a4dd5e-3313-4c04-a699-9184465e9895', 'attached_at': '', 'detached_at': '', 'volume_id': '2b6b19a4-9b37-451a-a517-92a140e6c9f4', 'serial': '2b6b19a4-9b37-451a-a517-92a140e6c9f4'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9da99649-e01d-4015-882c-7c7d28256469', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:43:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connector [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Factory for ISCSI on None {{(pid=75266) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjGNHuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:12 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:12 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:12 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e544c4d-5522-4bb4-9c52-3ddd1f538077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:12 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6f780-1992-499f-94fd-ba3b591b0bae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f] added
Nov 28 00:43:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk 1073741824" returned: 0 in 0.062s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46e736-9995-4c2d-90bb-9903b3ad9468]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Successfully created port: 67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdda4cb-d134-4d40-a991-c08d571f8f8b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjGNHuvQ {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjGNHuvQ" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c540df86-3009-4d8e-a849-1f0cbc6490fd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjGNHuvQ'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[36696a49-8e8b-4a02-8d8b-158a459c199c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[688b886a-596b-4f4a-9766-051fbd34da46]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 00:43:12 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 00:43:12 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:12 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 00:43:12 user nova-compute[75266]: 
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4448c7cf-8e00-4525-b7b8-c049ea5c5acb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260]
Nov 28 00:43:12 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2677e068-fc0a-45b9-a1b3-599419fe034a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0cd77d-b828-4b27-b080-5a9adb03142a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539f6a2-3c5a-48ed-8851-fb37cbe9e504]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjGNHuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Instance spawned successfully.
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Cannot resize image /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Ensure instance console log exists: /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] No waiting events found dispatching network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:12 user nova-compute[75266]: WARNING nova.compute.manager [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received unexpected event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 for instance with vm_state building and task_state spawning.
Nov 28 00:43:12 user nova-compute[75266]: INFO nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:12 user nova-compute[75266]: INFO nova.compute.manager [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Took 6.46 seconds to build instance.
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Successfully updated port: 67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquired lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:43:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Updating instance_info_cache with network_info: [{"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Releasing lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Instance network_info: |[{"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Start _get_guest_xml network_info=[{"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:43:13 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:13 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-539144485',display_name='tempest-VolumesNegativeTest-instance-539144485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-539144485',id=13,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f78eaf469545e2ba9232811de8e3a0',ramdisk_id='',reservation_id='r-8zycg9mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-493175275',owner_user_name='tempest-VolumesNegativeTest-493175275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:43:12Z,user_data=None,user_id='f853e07c209544cf88d39ad0a2f3a694',uuid=cd2dca4b-65fc-4db5-a4f0-60d592d1a4db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converting VIF {"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lazy-loading 'pci_devices' on Instance uuid cd2dca4b-65fc-4db5-a4f0-60d592d1a4db {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:43:13 user nova-compute[75266]:   <uuid>cd2dca4b-65fc-4db5-a4f0-60d592d1a4db</uuid>
Nov 28 00:43:13 user nova-compute[75266]:   <name>instance-0000000d</name>
Nov 28 00:43:13 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:43:13 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:43:13 user nova-compute[75266]:   <metadata>
Nov 28 00:43:13 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:43:13 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:name>tempest-VolumesNegativeTest-instance-539144485</nova:name>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:43:13</nova:creationTime>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:43:13 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:43:13 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:owner>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:user uuid="f853e07c209544cf88d39ad0a2f3a694">tempest-VolumesNegativeTest-493175275-project-member</nova:user>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:project uuid="67f78eaf469545e2ba9232811de8e3a0">tempest-VolumesNegativeTest-493175275</nova:project>
Nov 28 00:43:13 user nova-compute[75266]:       </nova:owner>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:43:13 user nova-compute[75266]:       <nova:ports>
Nov 28 00:43:13 user nova-compute[75266]:         <nova:port uuid="67eed799-ef90-48cc-a9c5-5c6243147147">
Nov 28 00:43:13 user nova-compute[75266]:           <nova:ip type="fixed" address="192.168.233.62" ipVersion="4"/>
Nov 28 00:43:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:13 user nova-compute[75266]:       </nova:ports>
Nov 28 00:43:13 user nova-compute[75266]:     </nova:instance>
Nov 28 00:43:13 user nova-compute[75266]:   </metadata>
Nov 28 00:43:13 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:43:13 user nova-compute[75266]:     <system>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="serial">cd2dca4b-65fc-4db5-a4f0-60d592d1a4db</entry>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="uuid">cd2dca4b-65fc-4db5-a4f0-60d592d1a4db</entry>
Nov 28 00:43:13 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:43:13 user nova-compute[75266]:     </system>
Nov 28 00:43:13 user nova-compute[75266]:   </sysinfo>
Nov 28 00:43:13 user nova-compute[75266]:   <os>
Nov 28 00:43:13 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:43:13 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:43:13 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:43:13 user nova-compute[75266]:   </os>
Nov 28 00:43:13 user nova-compute[75266]:   <features>
Nov 28 00:43:13 user nova-compute[75266]:     <acpi/>
Nov 28 00:43:13 user nova-compute[75266]:     <apic/>
Nov 28 00:43:13 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:43:13 user nova-compute[75266]:   </features>
Nov 28 00:43:13 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:43:13 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:43:13 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:43:13 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:43:13 user nova-compute[75266]:   </clock>
Nov 28 00:43:13 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:43:13 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:43:13 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:43:13 user nova-compute[75266]:   </cpu>
Nov 28 00:43:13 user nova-compute[75266]:   <devices>
Nov 28 00:43:13 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:43:13 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:43:13 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk"/>
Nov 28 00:43:13 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:43:13 user nova-compute[75266]:     </disk>
Nov 28 00:43:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:13 user nova-compute[75266]:       <mac address="fa:16:3e:48:64:8b"/>
Nov 28 00:43:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:13 user nova-compute[75266]:       <target dev="tap67eed799-ef"/>
Nov 28 00:43:13 user nova-compute[75266]:     </interface>
Nov 28 00:43:13 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:43:13 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/console.log" append="off"/>
Nov 28 00:43:13 user nova-compute[75266]:     </serial>
Nov 28 00:43:13 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:43:13 user nova-compute[75266]:     <video>
Nov 28 00:43:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:13 user nova-compute[75266]:     </video>
Nov 28 00:43:13 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:43:13 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:43:13 user nova-compute[75266]:     </rng>
Nov 28 00:43:13 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:43:13 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:43:13 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:43:13 user nova-compute[75266]:     </memballoon>
Nov 28 00:43:13 user nova-compute[75266]:   </devices>
Nov 28 00:43:13 user nova-compute[75266]: </domain>
Nov 28 00:43:13 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-539144485',display_name='tempest-VolumesNegativeTest-instance-539144485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-539144485',id=13,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f78eaf469545e2ba9232811de8e3a0',ramdisk_id='',reservation_id='r-8zycg9mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-493175275',owner_user_name='tempest-VolumesNegativeTest-493175275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:43:12Z,user_data=None,user_id='f853e07c209544cf88d39ad0a2f3a694',uuid=cd2dca4b-65fc-4db5-a4f0-60d592d1a4db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converting VIF {"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_vif [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f93697b9-d90d-5e43-b0d8-dacc2ee4992f', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67eed799-ef, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67eed799-ef, col_values=(('qos', UUID('ee0b22fc-420d-4ca0-96af-3ed57a9b5b37')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67eed799-ef, col_values=(('external_ids', {'iface-id': '67eed799-ef90-48cc-a9c5-5c6243147147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:64:8b', 'vm-uuid': 'cd2dca4b-65fc-4db5-a4f0-60d592d1a4db'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:13 user nova-compute[75266]: INFO os_vif [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef')
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] No VIF found with MAC fa:16:3e:48:64:8b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23135363362366162', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135363362366162', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkojhOIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:13 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266b93a-b491-40e0-aa48-56b6ebb9c7ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:13 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1436fda-40d8-48e8-a0cd-3359977aa3b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db] added
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb75f6-3fd1-448f-92c5-cbe705eaa4a4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b44691-273a-4b66-88e1-0cf7c5b1e4e8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EkojhOIp {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EkojhOIp" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaeb695-09f5-4fc2-863f-4bc98f0f43d9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EkojhOIp'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[031dbca8-d056-40ee-b12a-5a4628149cae]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294a191-2dad-43e6-9af4-3cb670e41bde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68a70d2-2746-480d-abca-4cea2aaeded0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260]
Nov 28 00:43:13 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c233c2a7-1ef5-4ebd-88c8-1e71166e3ec0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51e1b9-6e8b-4b15-89ad-eb91e704cbac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:13 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:13 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b6b1f5-dc56-4b8c-a5df-8c433e9e0f1f]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkojhOIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-changed-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Refreshing instance network info cache due to event network-changed-67eed799-ef90-48cc-a9c5-5c6243147147. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Acquiring lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Acquired lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Refreshing network info cache for port 67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23865616236366339', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865616236366339', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNgKcIGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:14 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:14 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:14 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95110fb-9b1a-4594-850a-fc6935e05490]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:14 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf3111a-ccad-4028-9973-e6306b87ae67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4] added
Nov 28 00:43:14 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] No waiting events found dispatching network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:14 user nova-compute[75266]: WARNING nova.compute.manager [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received unexpected event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 for instance with vm_state building and task_state spawning.
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e104f52-5425-4b5f-a3db-abfb0ca3da57]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b9c86-7984-4df3-9606-58e16f339210]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNgKcIGJ {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNgKcIGJ" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac94a77-11b7-4d4f-a34d-c1345695b51b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNgKcIGJ'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad115b48-0f76-4ac1-b76f-4a0b52463b98]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b0b2d-9596-4205-ac6c-800ea52501f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Updated VIF entry in instance network info cache for port 67eed799-ef90-48cc-a9c5-5c6243147147. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Updating instance_info_cache with network_info: [{"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc3d44-ce19-4514-aa61-aba16b1c71de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260]
Nov 28 00:43:15 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Releasing lock "refresh_cache-cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9cc6a-06c8-46cd-8606-c83553c9a2f9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7156c7-e7df-4cb6-97c9-fe58fd9ec533]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:15 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55f734b-97a7-4b30-8a3e-7255d4ef4ef0]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNgKcIGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:43:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26639646531323834', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639646531323834', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lazy-loading 'pci_devices' on Instance uuid 51a4dd5e-3313-4c04-a699-9184465e9895 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:43:16 user nova-compute[75266]:   <uuid>51a4dd5e-3313-4c04-a699-9184465e9895</uuid>
Nov 28 00:43:16 user nova-compute[75266]:   <name>instance-0000000b</name>
Nov 28 00:43:16 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:43:16 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:43:16 user nova-compute[75266]:   <metadata>
Nov 28 00:43:16 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:43:16 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:name>tempest-device-tagging-server-222609210</nova:name>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:43:12</nova:creationTime>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:43:16 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:43:16 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:owner>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:user uuid="c110bc80f8fa44f6863d2ebe961d2510">tempest-TaggedBootDevicesTest-2102994287-project-member</nova:user>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:project uuid="12a0f37585d44cc6a8f14651c74869c8">tempest-TaggedBootDevicesTest-2102994287</nova:project>
Nov 28 00:43:16 user nova-compute[75266]:       </nova:owner>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:43:16 user nova-compute[75266]:       <nova:ports>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="b4b1bb66-214e-4774-96ca-91634121b5d5">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="03619394-6a6e-497d-b570-4a288cdcd6f7">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="12d80f85-36dc-495d-9e2a-47ccaeafe267">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="93942af8-6733-4aa8-ab7a-6306b5196f30">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="f6ea4af3-eb88-4c03-a3bf-c852a8464e52">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="6b322b03-7a4e-4a72-8a3d-3cc3a485f801">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:         <nova:port uuid="c986d58d-26af-42f2-b152-4e31e6403c2c">
Nov 28 00:43:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 00:43:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:16 user nova-compute[75266]:       </nova:ports>
Nov 28 00:43:16 user nova-compute[75266]:     </nova:instance>
Nov 28 00:43:16 user nova-compute[75266]:   </metadata>
Nov 28 00:43:16 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:43:16 user nova-compute[75266]:     <system>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="serial">51a4dd5e-3313-4c04-a699-9184465e9895</entry>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="uuid">51a4dd5e-3313-4c04-a699-9184465e9895</entry>
Nov 28 00:43:16 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:43:16 user nova-compute[75266]:     </system>
Nov 28 00:43:16 user nova-compute[75266]:   </sysinfo>
Nov 28 00:43:16 user nova-compute[75266]:   <os>
Nov 28 00:43:16 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:43:16 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:43:16 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:43:16 user nova-compute[75266]:   </os>
Nov 28 00:43:16 user nova-compute[75266]:   <features>
Nov 28 00:43:16 user nova-compute[75266]:     <acpi/>
Nov 28 00:43:16 user nova-compute[75266]:     <apic/>
Nov 28 00:43:16 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:43:16 user nova-compute[75266]:   </features>
Nov 28 00:43:16 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:43:16 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:43:16 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:43:16 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:43:16 user nova-compute[75266]:   </clock>
Nov 28 00:43:16 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:43:16 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:43:16 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:43:16 user nova-compute[75266]:   </cpu>
Nov 28 00:43:16 user nova-compute[75266]:   <devices>
Nov 28 00:43:16 user nova-compute[75266]:     <disk type="file" device="cdrom">
Nov 28 00:43:16 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 00:43:16 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/disk.config"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="hda" bus="ide"/>
Nov 28 00:43:16 user nova-compute[75266]:     </disk>
Nov 28 00:43:16 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:43:16 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:16 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <serial>52865390-32c6-476c-b67a-61116319990f</serial>
Nov 28 00:43:16 user nova-compute[75266]:     </disk>
Nov 28 00:43:16 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:43:16 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:16 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <serial>6685b5b0-ebeb-4499-80de-9a81996811db</serial>
Nov 28 00:43:16 user nova-compute[75266]:     </disk>
Nov 28 00:43:16 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:43:16 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:16 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="vdc" bus="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <serial>2b6b19a4-9b37-451a-a517-92a140e6c9f4</serial>
Nov 28 00:43:16 user nova-compute[75266]:     </disk>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:6f:b3:27"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tapb4b1bb66-21"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:6e:25:29"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tap03619394-6a"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:08:5b:e7"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tap12d80f85-36"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:62:ee:94"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tap93942af8-67"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:53:3f:fd"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tapf6ea4af3-eb"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:af:99:aa"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tap6b322b03-7a"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:16 user nova-compute[75266]:       <mac address="fa:16:3e:bd:67:39"/>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:16 user nova-compute[75266]:       <target dev="tapc986d58d-26"/>
Nov 28 00:43:16 user nova-compute[75266]:     </interface>
Nov 28 00:43:16 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:43:16 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/console.log" append="off"/>
Nov 28 00:43:16 user nova-compute[75266]:     </serial>
Nov 28 00:43:16 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:43:16 user nova-compute[75266]:     <video>
Nov 28 00:43:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:16 user nova-compute[75266]:     </video>
Nov 28 00:43:16 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:43:16 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:43:16 user nova-compute[75266]:     </rng>
Nov 28 00:43:16 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:43:16 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:43:16 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:43:16 user nova-compute[75266]:     </memballoon>
Nov 28 00:43:16 user nova-compute[75266]:   </devices>
Nov 28 00:43:16 user nova-compute[75266]: </domain>
Nov 28 00:43:16 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '589d02a0-12d1-5ec9-87a1-d6f76511d1e1', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4b1bb66-21, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4b1bb66-21, col_values=(('qos', UUID('1f1f0253-0ac4-4322-9128-4caf9cb4aaa9')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4b1bb66-21, col_values=(('external_ids', {'iface-id': 'b4b1bb66-214e-4774-96ca-91634121b5d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:b3:27', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21')
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e55a5f3e-ef68-5ea1-99b9-0d3aa402be1c', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03619394-6a, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03619394-6a, col_values=(('qos', UUID('240537e6-a65d-47c4-975c-4800305c783c')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03619394-6a, col_values=(('external_ids', {'iface-id': '03619394-6a6e-497d-b570-4a288cdcd6f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:25:29', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a')
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1819bb59-f365-588c-abdd-fe523cd40247', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12d80f85-36, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12d80f85-36, col_values=(('qos', UUID('a30bd454-263e-47c0-808d-e4135a77dd09')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12d80f85-36, col_values=(('external_ids', {'iface-id': '12d80f85-36dc-495d-9e2a-47ccaeafe267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:5b:e7', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36')
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a34fc9-e1e9-59d8-9ad7-77f18a46e137', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93942af8-67, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93942af8-67, col_values=(('qos', UUID('b376f3c5-4484-4e13-8aa6-73ed2b30b0ad')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93942af8-67, col_values=(('external_ids', {'iface-id': '93942af8-6733-4aa8-ab7a-6306b5196f30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:ee:94', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67')
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c50b9ce1-dea0-5293-ab4c-ae3516cafe4c', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6ea4af3-eb, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6ea4af3-eb, col_values=(('qos', UUID('833bb37b-28ab-4961-8e29-6256b16f585c')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6ea4af3-eb, col_values=(('external_ids', {'iface-id': 'f6ea4af3-eb88-4c03-a3bf-c852a8464e52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:3f:fd', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:16 user nova-compute[75266]: INFO nova.compute.manager [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Rescuing
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb')
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac83bf1-f639-54ab-aca6-5528b9fa6930', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] No waiting events found dispatching network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:17 user nova-compute[75266]: WARNING nova.compute.manager [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received unexpected event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 for instance with vm_state building and task_state spawning.
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-changed-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Refreshing instance network info cache due to event network-changed-598b9806-e561-4d8b-9e33-1e8ec1268b48. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Refreshing network info cache for port 598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b322b03-7a, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b322b03-7a, col_values=(('qos', UUID('5fe3576c-0507-4e6e-aea9-ad74107529bd')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b322b03-7a, col_values=(('external_ids', {'iface-id': '6b322b03-7a4e-4a72-8a3d-3cc3a485f801', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:99:aa', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Instance spawned successfully.
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a')
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '430e309f-15fe-596f-aceb-64238a8ded8c', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: INFO nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc986d58d-26, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc986d58d-26, col_values=(('qos', UUID('0f80f565-da19-48cb-995a-49ee9d1eae9d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc986d58d-26, col_values=(('external_ids', {'iface-id': 'c986d58d-26af-42f2-b152-4e31e6403c2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:67:39', 'vm-uuid': '51a4dd5e-3313-4c04-a699-9184465e9895'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:17 user nova-compute[75266]: INFO os_vif [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26')
Nov 28 00:43:17 user nova-compute[75266]: INFO nova.compute.manager [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Took 6.59 seconds to build instance.
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] No BDM found with device name hda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] No VIF found with MAC fa:16:3e:6f:b3:27, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] No VIF found with MAC fa:16:3e:53:3f:fd, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Using config drive
Nov 28 00:43:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Creating config drive at /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/disk.config
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjrsdrw8y {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjrsdrw8y" returned: 0 in 0.075s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updated VIF entry in instance network info cache for port 598b9806-e561-4d8b-9e33-1e8ec1268b48. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:18 user nova-compute[75266]: INFO nova.compute.manager [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] instance snapshotting
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:18 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Beginning live snapshot process
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state rescuing.
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing instance network info cache due to event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG nova.network.neutron [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json -f qcow2" returned: 0 in 0.286s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28.delta 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.446s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28.delta 1073741824" returned: 0 in 0.488s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75266) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 00:43:19 user nova-compute[75266]: INFO nova.virt.libvirt.host [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] UEFI support detected
Nov 28 00:43:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:19 user nova-compute[75266]: DEBUG nova.objects.instance [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance destroyed successfully.
Nov 28 00:43:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Attempting rescue
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:43:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Creating image(s)
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.network.neutron [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated VIF entry in instance network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.network.neutron [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.220s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:20 user nova-compute[75266]: WARNING nova.compute.manager [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 for instance with vm_state building and task_state spawning.
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue" returned: 0 in 0.058s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'migration_context' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<3f32bed1-593f-4bf4-ba26-9496d83fc17f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start _get_guest_xml network_info=[{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:12:2a:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:20 user nova-compute[75266]: INFO nova.compute.manager [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Attaching volume 50546c9b-1f14-449e-b7dd-a9376344f840 to /dev/vdb
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<3f32bed1-593f-4bf4-ba26-9496d83fc17f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:20 user nova-compute[75266]: WARNING nova.compute.manager [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state rescuing.
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<3f32bed1-593f-4bf4-ba26-9496d83fc17f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<3f32bed1-593f-4bf4-ba26-9496d83fc17f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1646530713',display_name='tempest-ServerRescueNegativeTestJSON-server-1646530713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1646530713',id=4,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-k0f7b6ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:47Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=3f32bed1-593f-4bf4-ba26-9496d83fc17f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:12:2a:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:12:2a:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.utils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fc1a4-b593-44a8-bae2-796dd6eb1c49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<3f32bed1-593f-4bf4-ba26-9496d83fc17f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:43:20 user nova-compute[75266]:   <uuid>3f32bed1-593f-4bf4-ba26-9496d83fc17f</uuid>
Nov 28 00:43:20 user nova-compute[75266]:   <name>instance-00000004</name>
Nov 28 00:43:20 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:43:20 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:43:20 user nova-compute[75266]:   <metadata>
Nov 28 00:43:20 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:43:20 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1646530713</nova:name>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:43:20</nova:creationTime>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:43:20 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:43:20 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:owner>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:43:20 user nova-compute[75266]:       </nova:owner>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:43:20 user nova-compute[75266]:       <nova:ports>
Nov 28 00:43:20 user nova-compute[75266]:         <nova:port uuid="625efbe6-4ffa-44c8-90e8-3bb69f390dbb">
Nov 28 00:43:20 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:43:20 user nova-compute[75266]:         </nova:port>
Nov 28 00:43:20 user nova-compute[75266]:       </nova:ports>
Nov 28 00:43:20 user nova-compute[75266]:     </nova:instance>
Nov 28 00:43:20 user nova-compute[75266]:   </metadata>
Nov 28 00:43:20 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:43:20 user nova-compute[75266]:     <system>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="serial">3f32bed1-593f-4bf4-ba26-9496d83fc17f</entry>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="uuid">3f32bed1-593f-4bf4-ba26-9496d83fc17f</entry>
Nov 28 00:43:20 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:43:20 user nova-compute[75266]:     </system>
Nov 28 00:43:20 user nova-compute[75266]:   </sysinfo>
Nov 28 00:43:20 user nova-compute[75266]:   <os>
Nov 28 00:43:20 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:43:20 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:43:20 user nova-compute[75266]:   </os>
Nov 28 00:43:20 user nova-compute[75266]:   <features>
Nov 28 00:43:20 user nova-compute[75266]:     <acpi/>
Nov 28 00:43:20 user nova-compute[75266]:     <apic/>
Nov 28 00:43:20 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:43:20 user nova-compute[75266]:   </features>
Nov 28 00:43:20 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:43:20 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:43:20 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:43:20 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:43:20 user nova-compute[75266]:   </clock>
Nov 28 00:43:20 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:43:20 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:43:20 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:43:20 user nova-compute[75266]:   </cpu>
Nov 28 00:43:20 user nova-compute[75266]:   <devices>
Nov 28 00:43:20 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:43:20 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:43:20 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue"/>
Nov 28 00:43:20 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:43:20 user nova-compute[75266]:     </disk>
Nov 28 00:43:20 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:43:20 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:43:20 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk"/>
Nov 28 00:43:20 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:43:20 user nova-compute[75266]:     </disk>
Nov 28 00:43:20 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:43:20 user nova-compute[75266]:       <mac address="fa:16:3e:12:2a:2f"/>
Nov 28 00:43:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:20 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:43:20 user nova-compute[75266]:       <target dev="tap625efbe6-4f"/>
Nov 28 00:43:20 user nova-compute[75266]:     </interface>
Nov 28 00:43:20 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:43:20 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/console.log" append="off"/>
Nov 28 00:43:20 user nova-compute[75266]:     </serial>
Nov 28 00:43:20 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:43:20 user nova-compute[75266]:     <video>
Nov 28 00:43:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:43:20 user nova-compute[75266]:     </video>
Nov 28 00:43:20 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:43:20 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:43:20 user nova-compute[75266]:     </rng>
Nov 28 00:43:20 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:43:20 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:43:20 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:43:20 user nova-compute[75266]:     </memballoon>
Nov 28 00:43:20 user nova-compute[75266]:   </devices>
Nov 28 00:43:20 user nova-compute[75266]: </domain>
Nov 28 00:43:20 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a68ba-abf9-4efb-a814-49c2d3a2673c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62de451-4b0f-41f6-8c95-3e0a756c0143]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance destroyed successfully.
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee089ed-05db-439a-a7b7-9726d70ec474]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:20 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265f07f-ab75-480f-89af-ae1a752183bd]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG os_brick.utils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating existing volume attachment record: ca1ac1d2-7aaa-41eb-877b-58fec0ce76d2 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:12:2a:2f, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:21 user nova-compute[75266]: WARNING nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 for instance with vm_state building and task_state spawning.
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:21 user nova-compute[75266]: WARNING nova.compute.manager [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 for instance with vm_state building and task_state spawning.
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:43:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state rescuing.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state active and task_state rescuing.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.compute.manager [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c for instance with vm_state building and task_state spawning.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance spawned successfully.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=6867MB free_disk=25.42736053466797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28.delta /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:43:27 user nova-compute[75266]: INFO nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Took 15.81 seconds to spawn the instance on the hypervisor.
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 86575409-89de-4408-a573-d069767ebb15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 46fb5677-018f-4e32-b945-166600ec6a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 51a4dd5e-3313-4c04-a699-9184465e9895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 2619f610-3a3c-4b48-9448-c30d75414e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:43:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:43:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28.delta /opt/stack/data/nova/instances/snapshots/tmpxwa0ulzc/1b6d8ba227fb4e1cbc4892e3b78b7c28" returned: 0 in 0.470s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:28 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Snapshot extracted, beginning image upload
Nov 28 00:43:28 user nova-compute[75266]: INFO nova.compute.manager [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Took 45.20 seconds to build instance.
Nov 28 00:43:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.302s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:28 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:43:28 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:43:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:43:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.060s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:29 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:29 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:29 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c67576-97ff-405b-985a-c6fea357e964]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:29 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4480e182-9369-4cd5-8398-660555b340d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840] added
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8380ec9-7e84-484b-97ca-e060afa1309b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b6a73-2b96-44ed-8e95-6643aad462d5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKMiafcG {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKMiafcG" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c1bc2-95cf-4d21-a0ee-dc94b4c78de3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKMiafcG'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e97040f-459a-4a2c-986a-a38ba1cd6310]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[10814990-7fff-4b27-bd0f-f1766223ff4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8416c9-f123-4f42-bb17-038064aef99a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]
Nov 28 00:43:29 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[927da0d6-8a61-428b-99f7-b63c451f03e4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba253d8f-3177-4683-940f-2b11e27a2251]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d8da8-d129-4240-80a7-4aa4d917c545]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23039643738396136', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039643738396136', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG nova.objects.instance [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:43:30 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:30 user nova-compute[75266]:   <source dev="/dev/sde"/>
Nov 28 00:43:30 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:30 user nova-compute[75266]:   <serial>50546c9b-1f14-449e-b7dd-a9376344f840</serial>
Nov 28 00:43:30 user nova-compute[75266]: </disk>
Nov 28 00:43:30 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No VIF found with MAC fa:16:3e:6b:f5:56, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Snapshot image upload complete
Nov 28 00:43:31 user nova-compute[75266]: INFO nova.compute.manager [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Took 13.35 seconds to snapshot the instance on the hypervisor.
Nov 28 00:43:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.173s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-changed-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Refreshing instance network info cache due to event network-changed-7b8ba726-9082-4459-86ba-f4317c342dbe. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Acquiring lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Acquired lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.network.neutron [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Refreshing network info cache for port 7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75266) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:33 user nova-compute[75266]: WARNING nova.compute.manager [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state active and task_state powering-off.
Nov 28 00:43:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updated VIF entry in instance network info cache for port 7b8ba726-9082-4459-86ba-f4317c342dbe. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating instance_info_cache with network_info: [{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Releasing lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance destroyed successfully.
Nov 28 00:43:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:43:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.926s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:35 user nova-compute[75266]: WARNING nova.compute.manager [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state None.
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'flavor' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:35 user nova-compute[75266]: INFO nova.compute.manager [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Attaching volume 4d514648-03b2-4c05-bf1e-78e75e393d2f to /dev/vdb
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e848d-e25a-4d53-a3fb-efa8ad03ae16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.132s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5145a2c-0367-4611-a805-0948d75dcec7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9372965a-9df6-4512-969e-16bd799511ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945f884-078d-4bbf-acee-bddc33237b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:35 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3c40c-3026-4dd2-acdf-5e7bf767fed8]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] <== get_connector_properties: return (231ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:35 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating existing volume attachment record: 25f52230-58b8-488c-bb85-6560ad0f7ffc {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-changed-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Refreshing instance network info cache due to event network-changed-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Acquiring lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Acquired lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Refreshing network info cache for port f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updated VIF entry in instance network info cache for port f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating instance_info_cache with network_info: [{"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Releasing lock "refresh_cache-b8080c31-0df3-44ba-8586-b1ca39d9c97e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-changed-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing instance network info cache due to event network-changed-734679ea-803f-454c-ad23-ed3bbd4951e5. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing network info cache for port 734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "interface-86575409-89de-4408-a573-d069767ebb15-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "interface-86575409-89de-4408-a573-d069767ebb15-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updated VIF entry in instance network info cache for port 734679ea-803f-454c-ad23-ed3bbd4951e5. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'pci_requests' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.objects.base [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Object Instance<86575409-89de-4408-a573-d069767ebb15> lazy-loaded attributes: flavor,pci_requests {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.policy [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSgFdbus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:43 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:43 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:43 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe7d4d-24f3-48b1-b1ae-e7448cc55293]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:43 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d463a06-8b23-40e0-94a9-aafdff69b850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f] added
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a601fe1-4be2-4646-a13b-12587dc7508a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86300ed-f759-4148-8930-5d65a321ff97]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSgFdbus {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSgFdbus" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[737c7979-d0d0-4b19-8123-1234e028e5b0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OSgFdbus'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5c956-4bc0-4df8-8030-ea9f57b7b788]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Successfully created port: cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72e214-b835-4f85-93a3-817363c31236]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38d523-975b-4fcb-9204-bb706f477cb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260]
Nov 28 00:43:43 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462109b-1c15-41e8-8e11-e1809cd83777]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3307c6-5470-4bc2-ad3d-d4ce69313c87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:43 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5506d-ef49-40af-b0be-a0eb8fe82beb]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSgFdbus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Successfully updated port: cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'flavor' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-changed-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing instance network info cache due to event network-changed-cb19ffde-74b9-41c3-9577-eb9064e539a6. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-changed-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Refreshing instance network info cache due to event network-changed-d958f7e8-8730-4756-8515-ce61c1d1efce. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Acquiring lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Acquired lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.network.neutron [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Refreshing network info cache for port d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:44 user nova-compute[75266]: INFO nova.compute.manager [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Attaching volume 55ed410b-6916-49f0-bb09-359798600e75 to /dev/sdc
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.utils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3151840-bd5a-43fb-8353-ada8e33eb7e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ae9406-2b56-4424-9ff8-109a36f137f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fac516-83bf-4b87-90c7-9bc98f58f00a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7225b2-bca7-49ff-ba42-7d81b1360ffd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'flavor' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26231623233376636', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231623233376636', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:44 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bfe0d0-74fc-4cb3-973d-614c727b5b81]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG os_brick.utils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating existing volume attachment record: ba0fb853-9ba7-4e23-bfeb-03ffd88dc8b8 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'flavor' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:43:45 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:45 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:43:45 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:45 user nova-compute[75266]:   <serial>4d514648-03b2-4c05-bf1e-78e75e393d2f</serial>
Nov 28 00:43:45 user nova-compute[75266]: </disk>
Nov 28 00:43:45 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.210s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updated VIF entry in instance network info cache for port d958f7e8-8730-4756-8515-ce61c1d1efce. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating instance_info_cache with network_info: [{"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Releasing lock "refresh_cache-46fb5677-018f-4e32-b945-166600ec6a24" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:45 user nova-compute[75266]: INFO nova.compute.manager [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attaching volume 03ee4663-c44a-45b0-8721-f33b791fcbbf to /dev/vdb
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Refreshing network info cache for port cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_vif [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429dc36d-f6b8-52f6-bc0b-899f961ed37a', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb19ffde-74, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb19ffde-74, col_values=(('qos', UUID('24b1785a-a8d2-4eec-9efd-f437f5df8ac9')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb19ffde-74, col_values=(('external_ids', {'iface-id': 'cb19ffde-74b9-41c3-9577-eb9064e539a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:27:ce', 'vm-uuid': '86575409-89de-4408-a573-d069767ebb15'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.utils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: INFO os_vif [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74')
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093e8fc-9217-497c-b2e1-841ee92e7aaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] attach device xml: <interface type="ethernet">
Nov 28 00:43:45 user nova-compute[75266]:   <mac address="fa:16:3e:dd:27:ce"/>
Nov 28 00:43:45 user nova-compute[75266]:   <model type="virtio"/>
Nov 28 00:43:45 user nova-compute[75266]:   <mtu size="1442"/>
Nov 28 00:43:45 user nova-compute[75266]:   <target dev="tapcb19ffde-74"/>
Nov 28 00:43:45 user nova-compute[75266]: </interface>
Nov 28 00:43:45 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a904b-238d-4d20-9ba4-4bdf6a773c34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6188ec4-a8e4-4213-8e7e-f12221c34413]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e1463-2fd8-4161-93c9-f27eaa75022a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:45 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1543779-782c-4562-91fc-cab64ae68ed9]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG os_brick.utils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating existing volume attachment record: 7ae3c76a-2b5d-4d0f-91f3-6abda1c6a096 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No VIF found with MAC fa:16:3e:03:99:69, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updated VIF entry in instance network info cache for port cb19ffde-74b9-41c3-9577-eb9064e539a6. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name hda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No VIF found with MAC fa:16:3e:bb:af:f2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:43:46 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:43:46</nova:creationTime>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:43:46 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:43:46 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:owner>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:43:46 user nova-compute[75266]:   </nova:owner>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:43:46 user nova-compute[75266]:   <nova:ports>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:43:46 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:43:46 user nova-compute[75266]:     </nova:port>
Nov 28 00:43:46 user nova-compute[75266]:     <nova:port uuid="cb19ffde-74b9-41c3-9577-eb9064e539a6">
Nov 28 00:43:46 user nova-compute[75266]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Nov 28 00:43:46 user nova-compute[75266]:     </nova:port>
Nov 28 00:43:46 user nova-compute[75266]:   </nova:ports>
Nov 28 00:43:46 user nova-compute[75266]: </nova:instance>
Nov 28 00:43:46 user nova-compute[75266]:  {{(pid=75266) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.527s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "interface-86575409-89de-4408-a573-d069767ebb15-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.320s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:46 user nova-compute[75266]: WARNING nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance with vm_state active and task_state None.
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:43:46 user nova-compute[75266]: WARNING nova.compute.manager [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance with vm_state active and task_state None.
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:46 user nova-compute[75266]: INFO nova.compute.manager [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Attaching volume 05f69d2e-08e3-4ffa-ab94-250d56a5431c to /dev/vdb
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.utils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[091abaa3-e5d7-4e5b-b9a1-7121672322ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2019e236-92f0-4000-9b3f-982ad6fafb7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea2575-f832-4723-9cab-2455a0f19c91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[734eb5a2-34d5-4db7-a120-1c975f87c572]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:46 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8405148-2c3e-47af-8e24-0d2b351138c2]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG os_brick.utils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:46 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating existing volume attachment record: d653aaa7-be2e-4a65-8113-50fa3a5f000f {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCthIKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:52 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:52 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:52 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e811ea-a78e-4f00-bb5d-4e450a7d8d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:53 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b8cfb-0ee7-4c86-9280-a28de4f9b0fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75] added
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758aae6-8fba-4493-9404-fc783b5885e6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa8e3f-26f2-4a2c-b4a2-1b0e4bbfbe5f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCthIKA {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpCthIKA" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab1aff8-969b-4e8d-8efb-6af84f483183]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpCthIKA'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[964dc7a9-6cab-46e1-8935-471427992f4c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[203711bb-8b83-4d56-9269-31a65822f7a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[891b131b-9b28-43dc-b58f-a588312fb4b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260]
Nov 28 00:43:53 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-changed-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Refreshing instance network info cache due to event network-changed-cd82c939-7f4c-4114-97c2-9a4f166d9e23. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Acquiring lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Acquired lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Refreshing network info cache for port cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8b158-c097-4b78-ab2f-af01b429d13d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: INFO nova.compute.manager [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Detaching volume 4d514648-03b2-4c05-bf1e-78e75e393d2f
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df0a69-8f09-4249-93cb-6b8177f4ac00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:53 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[68230f58-91c7-4f75-83dd-c241765c5714]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCthIKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:53 user nova-compute[75266]: INFO nova.virt.block_device [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Attempting to driver detach volume 4d514648-03b2-4c05-bf1e-78e75e393d2f from mountpoint /dev/vdb
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Attempting to detach device vdb from instance 6f443cac-7a1c-49d2-9ed1-79a13883688a from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:53 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:53 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:43:53 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:53 user nova-compute[75266]:   <serial>4d514648-03b2-4c05-bf1e-78e75e393d2f</serial>
Nov 28 00:43:53 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:43:53 user nova-compute[75266]: </disk>
Nov 28 00:43:53 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:53 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully detached device vdb from instance 6f443cac-7a1c-49d2-9ed1-79a13883688a from the persistent domain config.
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f443cac-7a1c-49d2-9ed1-79a13883688a from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:53 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:53 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:43:53 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:53 user nova-compute[75266]:   <serial>4d514648-03b2-4c05-bf1e-78e75e393d2f</serial>
Nov 28 00:43:53 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:43:53 user nova-compute[75266]: </disk>
Nov 28 00:43:53 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:53 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lazy-loading 'flavor' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updated VIF entry in instance network info cache for port cd82c939-7f4c-4114-97c2-9a4f166d9e23. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating instance_info_cache with network_info: [{"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:53 user nova-compute[75266]: INFO nova.compute.manager [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Attaching volume a7afd95d-540d-416f-bf05-2720e4123cae to /dev/vdb
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Releasing lock "refresh_cache-fdea5f7d-ce77-4c66-afac-ddc24baeabd9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.utils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c7997-3885-48ff-a3ee-bb865e4902da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f67fb-ae92-4d2f-91a4-592845a17367]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616862f-f726-4352-b3c5-eca348f0bf61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b648c-8587-4930-b79a-0b8783780548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:54 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b116830-79eb-46c7-89a1-0ebcc5d785b5]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.utils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating existing volume attachment record: 41a7bf45-0496-409b-9fcf-bf09ae25fec3 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26231666337666264', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231666337666264', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.847s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:54 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'flavor' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e8a1f-36a1-4328-b008-993f1c05e6db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:54 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a4f74d-3951-4400-a1f2-50ab5aaac515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf] added
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:43:54 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:54 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:43:54 user nova-compute[75266]:   <target dev="sdc" bus="scsi"/>
Nov 28 00:43:54 user nova-compute[75266]:   <serial>55ed410b-6916-49f0-bb09-359798600e75</serial>
Nov 28 00:43:54 user nova-compute[75266]:   <address type="drive" controller="0" unit="2"/>
Nov 28 00:43:54 user nova-compute[75266]: </disk>
Nov 28 00:43:54 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b13bbf-29fd-45b5-a0a0-fca7fc5271fa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e011be73-e5e1-4267-88bf-a1d8987390b2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQGChzrR {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQGChzrR" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff3d9d-2747-4cb9-b64c-693d69aad0ad]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQGChzrR'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96994eb-0457-43ab-afeb-4cfc8286c63f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99605a0-746f-400f-bb22-9d5e94671631]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdc85c9-a6d0-4607-8df7-a39f7744313f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]
Nov 28 00:43:54 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgTumdHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6734614-9f75-4b62-81ba-c5747b5eac69]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b5e7bc-1cee-4c09-ad3a-3b95310a3d2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:54 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5dc5df-936d-4601-9309-76d7420dda8d]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No BDM found with device name sda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] No VIF found with MAC fa:16:3e:ac:9b:f4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.326s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] <== connect_volume: return (2183ms) {'type': 'block', 'scsi_wwn': '26665613031663239', 'path': '/dev/sdh'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665613031663239', 'path': '/dev/sdh'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.080s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:55 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:43:55 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.objects.instance [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'flavor' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa02c7f-bd8b-403e-bfaf-f66f73009492]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:43:55 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:43:55 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:55 user nova-compute[75266]:   <source dev="/dev/sdh"/>
Nov 28 00:43:55 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:55 user nova-compute[75266]:   <serial>03ee4663-c44a-45b0-8721-f33b791fcbbf</serial>
Nov 28 00:43:55 user nova-compute[75266]: </disk>
Nov 28 00:43:55 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d7fdb-686a-4c52-aa86-0ee486ac74e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c] added
Nov 28 00:43:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: INFO nova.compute.manager [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Detaching volume 55ed410b-6916-49f0-bb09-359798600e75
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b39c07-d33d-4b03-b509-7c2670d35b42]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f5f533-3657-4e62-a3f2-bf880c2a3dd8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgTumdHE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: INFO nova.virt.block_device [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Attempting to driver detach volume 55ed410b-6916-49f0-bb09-359798600e75 from mountpoint /dev/sdc
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kgTumdHE" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b601ee1-e102-4885-8f47-fb3ec50d5993]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kgTumdHE'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Attempting to detach device sdc from instance b8080c31-0df3-44ba-8586-b1ca39d9c97e from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:55 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:55 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:43:55 user nova-compute[75266]:   <target dev="sdc" bus="scsi"/>
Nov 28 00:43:55 user nova-compute[75266]:   <serial>55ed410b-6916-49f0-bb09-359798600e75</serial>
Nov 28 00:43:55 user nova-compute[75266]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 00:43:55 user nova-compute[75266]: </disk>
Nov 28 00:43:55 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:55 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Successfully detached device sdc from instance b8080c31-0df3-44ba-8586-b1ca39d9c97e from the persistent domain config.
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b8080c31-0df3-44ba-8586-b1ca39d9c97e from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:55 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:55 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:43:55 user nova-compute[75266]:   <target dev="sdc" bus="scsi"/>
Nov 28 00:43:55 user nova-compute[75266]:   <serial>55ed410b-6916-49f0-bb09-359798600e75</serial>
Nov 28 00:43:55 user nova-compute[75266]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 00:43:55 user nova-compute[75266]: </disk>
Nov 28 00:43:55 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b004c-6e30-4592-9b71-52d7aaa9314a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[720ca35f-472f-4406-b6c6-ef6d82180490]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:55 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a21cf-62ad-44b3-b533-36b2da3df53b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260]
Nov 28 00:43:56 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260] successful.
Nov 28 00:43:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7589320-0282-4ce5-8f44-00e1a6249f8e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[13462300-f23f-4924-a4c1-870e556e3bb3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:43:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:43:56 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:43:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973490b-75cf-4144-ad0f-e34e0e31ed37]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgTumdHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] No VIF found with MAC fa:16:3e:28:53:e2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.118s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] <== connect_volume: return (2458ms) {'type': 'block', 'scsi_wwn': '23634356637396336', 'path': '/dev/sdi'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634356637396336', 'path': '/dev/sdi'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:43:57 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:57 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:43:57 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:57 user nova-compute[75266]:   <serial>05f69d2e-08e3-4ffa-ab94-250d56a5431c</serial>
Nov 28 00:43:57 user nova-compute[75266]: </disk>
Nov 28 00:43:57 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No BDM found with device name hda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] No VIF found with MAC fa:16:3e:bb:af:f2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:43:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.953s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.utils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664334a-393e-43af-b7a7-d1a4a43b0226]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee47e9ea-4460-47f1-93ee-14f56fb208bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96ad23-61e9-4d5b-857e-edb242fd5269]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e66ce-9927-4f87-994d-37a7d0a3c7c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:43:58 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:43:58 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea5e912-1fd4-41bf-9538-de616fc1d58c]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:43:58 user nova-compute[75266]: DEBUG os_brick.utils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:43:58 user nova-compute[75266]: INFO nova.compute.manager [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Swapping volume 03ee4663-c44a-45b0-8721-f33b791fcbbf for f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:43:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:43:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:43:59 user nova-compute[75266]: INFO nova.compute.manager [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Detaching volume 05f69d2e-08e3-4ffa-ab94-250d56a5431c
Nov 28 00:43:59 user nova-compute[75266]: INFO nova.virt.block_device [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Attempting to driver detach volume 05f69d2e-08e3-4ffa-ab94-250d56a5431c from mountpoint /dev/vdb
Nov 28 00:43:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Attempting to detach device vdb from instance 86575409-89de-4408-a573-d069767ebb15 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:43:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:59 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:59 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:43:59 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:59 user nova-compute[75266]:   <serial>05f69d2e-08e3-4ffa-ab94-250d56a5431c</serial>
Nov 28 00:43:59 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 00:43:59 user nova-compute[75266]: </disk>
Nov 28 00:43:59 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully detached device vdb from instance 86575409-89de-4408-a573-d069767ebb15 from the persistent domain config.
Nov 28 00:43:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86575409-89de-4408-a573-d069767ebb15 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:43:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:43:59 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:43:59 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:43:59 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:43:59 user nova-compute[75266]:   <serial>05f69d2e-08e3-4ffa-ab94-250d56a5431c</serial>
Nov 28 00:43:59 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 00:43:59 user nova-compute[75266]: </disk>
Nov 28 00:43:59 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:43:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:44:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPgSiwsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:01 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:01 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:01 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e025115-6984-4fda-a568-39458dea1998]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:44:01 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66f66a-d08f-4b53-91f2-71a9870c529f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae] added
Nov 28 00:44:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d051be64-68f8-45dc-b347-4712a2a295b9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a04c0-0545-4aeb-b797-46b518103a59]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPgSiwsm {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPgSiwsm" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f6c62-4a7c-460d-aef1-a7127a456a64]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPgSiwsm'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe6ee1-7628-4b30-a295-805ac8a69470]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[034dead3-aece-41f4-bdd2-acc619f5c522]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:01 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965f0d0-2063-4128-a78f-51ab3fafafc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260]
Nov 28 00:44:02 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[64901eec-3d68-4e6a-aded-840b26adb1b4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db540670-63a2-4569-8ab8-92fc9d68b0ee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:02 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2da43-e379-4f85-b609-c606bf041ddd]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:44:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPgSiwsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23661333839653434', 'path': '/dev/sdj'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661333839653434', 'path': '/dev/sdj'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lazy-loading 'flavor' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 00:44:03 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:44:03 user nova-compute[75266]:   <source dev="/dev/sdj"/>
Nov 28 00:44:03 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:44:03 user nova-compute[75266]:   <serial>a7afd95d-540d-416f-bf05-2720e4123cae</serial>
Nov 28 00:44:03 user nova-compute[75266]: </disk>
Nov 28 00:44:03 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] No VIF found with MAC fa:16:3e:f8:1a:64, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:44:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.941s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] volume_snapshot_create: create_info: {'snapshot_id': '55850b93-9db7-4814-9260-2c69dfa403d8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75266) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 00:44:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] snap xml: <domainsnapshot>
Nov 28 00:44:04 user nova-compute[75266]:   <disks>
Nov 28 00:44:04 user nova-compute[75266]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 28 00:44:04 user nova-compute[75266]:       <source file="/dev/new_file"/>
Nov 28 00:44:04 user nova-compute[75266]:     </disk>
Nov 28 00:44:04 user nova-compute[75266]:     <disk name="vda" snapshot="no"/>
Nov 28 00:44:04 user nova-compute[75266]:   </disks>
Nov 28 00:44:04 user nova-compute[75266]: </domainsnapshot>
Nov 28 00:44:04 user nova-compute[75266]:  {{(pid=75266) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 00:44:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lazy-loading 'system_metadata' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     rv = execute(f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     six.reraise(c, e, tb)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     raise value
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     rv = meth(*args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     self._volume_snapshot_create(context, instance, guest,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     rv = execute(f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     six.reraise(c, e, tb)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     raise value
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     rv = meth(*args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] 
Nov 28 00:44:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] volume_snapshot_delete: delete_info: {'volume_id': 'a7afd95d-540d-416f-bf05-2720e4123cae'} {{(pid=75266) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9]     if delete_info['type'] != 'qcow2':
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] KeyError: 'type'
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 55850b93-9db7-4814-9260-2c69dfa403d8 could not be found.
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 55850b93-9db7-4814-9260-2c69dfa403d8 could not be found. (HTTP 404) (Request-ID: req-2604c8d6-73cd-459a-959b-a56efc11f46d)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 55850b93-9db7-4814-9260-2c69dfa403d8 could not be found.
Nov 28 00:44:04 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server 
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f4db359d-f887-4010-8bc0-903722e9fa3c)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 00:44:05 user nova-compute[75266]: ERROR nova.virt.libvirt.driver 
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Exception during message handling: KeyError: 'type'
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 00:44:05 user nova-compute[75266]: ERROR oslo_messaging.rpc.server 
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:05 user nova-compute[75266]: INFO nova.compute.manager [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Detaching volume a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:05 user nova-compute[75266]: INFO nova.virt.block_device [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Attempting to driver detach volume a7afd95d-540d-416f-bf05-2720e4123cae from mountpoint /dev/vdb
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Attempting to detach device vdb from instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 00:44:05 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:44:05 user nova-compute[75266]:   <source dev="/dev/sdj"/>
Nov 28 00:44:05 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:44:05 user nova-compute[75266]:   <serial>a7afd95d-540d-416f-bf05-2720e4123cae</serial>
Nov 28 00:44:05 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:44:05 user nova-compute[75266]: </disk>
Nov 28 00:44:05 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:05 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Successfully detached device vdb from instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 from the persistent domain config.
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 00:44:05 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:44:05 user nova-compute[75266]:   <source dev="/dev/sdj"/>
Nov 28 00:44:05 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:44:05 user nova-compute[75266]:   <serial>a7afd95d-540d-416f-bf05-2720e4123cae</serial>
Nov 28 00:44:05 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:44:05 user nova-compute[75266]: </disk>
Nov 28 00:44:05 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'serial': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': '03ee4663-c44a-45b0-8721-f33b791fcbbf', 'serial'} {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:05 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:05 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:05 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da2821-b2bb-4688-9553-6008164a9cd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:44:05 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db7cee-a092-4d70-b0ec-c1ed58eb7e2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24] added
Nov 28 00:44:05 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c412a9c-9164-4899-a2d8-34a677c14c32]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1d2ad-f7e3-4ac2-b503-9ed5a8126e4f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxaleiud {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxaleiud" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1a067-bc80-4c2d-806b-939b5d50b423]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxaleiud'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954dccf-fea0-4212-a7f6-b5238168e5e9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a7bace-05af-4dc5-b485-ebab1f924f2b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d0b77-591e-4d7f-8a1e-9b6dfd0165db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260]
Nov 28 00:44:06 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1759f4-d0dd-4757-b3d5-35a7234eaab9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99b651-689d-4185-8bfd-716199908574]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:06 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab5193b-0b20-4779-9015-2b0d022c8671]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:44:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:44:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26562383163623565', 'path': '/dev/sdk'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383163623565', 'path': '/dev/sdk'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:44:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lazy-loading 'flavor' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 100663296 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 206569472 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 377487360 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 560988160 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 701497344 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 1034944512 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:11 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d1c38-3fa0-455a-8674-685f9670272b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:11 user nova-compute[75266]: No targets found.
Nov 28 00:44:11 user nova-compute[75266]: iSNS:
Nov 28 00:44:11 user nova-compute[75266]: No targets found.
Nov 28 00:44:11 user nova-compute[75266]: STATIC:
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f
Nov 28 00:44:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:11 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:11 user nova-compute[75266]: No targets found.
Nov 28 00:44:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:11 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:11 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18a0bf5-481c-463e-a4c2-933bb01db004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[69201a1d-9223-4e73-8aba-dc61bffd1e94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:12 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c537be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf'): ({'sdh'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Removing single pathed devices sdh {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedf315-69e2-4362-95ba-34817cce7921]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f08abe-805b-408b-8a69-491726b5e5ff]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Flushing IO for device /dev/sdh {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3317bb-fd97-404e-bc1b-db0eace9ee96]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a194820d-cbfc-44ac-b1e9-502793df224b]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced11d5f-567c-4e74-ae57-a70787e7c767]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916769f-33c6-4709-885b-1234753890ca]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]
Nov 28 00:44:12 user nova-compute[75266]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[66148e1d-41f3-469f-b91d-b19d14380ae4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== disconnect_volume: return (391ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'serial'} {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 00:44:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: removing Cinder connection for volume 03ee4663-c44a-45b0-8721-f33b791fcbbf {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: Updating volume 03ee4663-c44a-45b0-8721-f33b791fcbbf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "kxaleiud", "auth_password": "yMCpgexlKwhF5R", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24"}, "status": "reserved", "instance": "46fb5677-018f-4e32-b945-166600ec6a24", "attached_at": "", "detached_at": "", "volume_id": "f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24", "serial": "f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'no_device': None, 'attachment_id': 'e110cbe8-ac58-406c-9ed9-ca62ead98dc8'} {{(pid=75266) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.276s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:13 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f443cac-7a1c-49d2-9ed1-79a13883688a is timed out.
Nov 28 00:44:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully detached device vdb from instance 6f443cac-7a1c-49d2-9ed1-79a13883688a from the live domain config.
Nov 28 00:44:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSgFdbus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b622acc7-a871-44c8-8d18-5c0557f8d81d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:13 user nova-compute[75266]: No targets found.
Nov 28 00:44:13 user nova-compute[75266]: iSNS:
Nov 28 00:44:13 user nova-compute[75266]: No targets found.
Nov 28 00:44:13 user nova-compute[75266]: STATIC:
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f
Nov 28 00:44:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:13 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:13 user nova-compute[75266]: No targets found.
Nov 28 00:44:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:13 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:13 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a764734-b626-4434-8594-b6815218f04d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7297c04-2138-4882-9833-78782782093f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:13 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c22fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69445b-60fc-445a-b152-d3e7f006ae4e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6b80a-95db-447d-b82b-44c98e547238]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4096b4-da81-4a5b-8aa1-5fd8c7cf2bd8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[39acd127-ac15-4a39-864b-d0f8d3db9b24]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb6973-e803-493a-aab8-195a85c4cda4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff81fb-fe58-4bb1-b4fc-386b34583137]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260]
Nov 28 00:44:14 user nova-compute[75266]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:14 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d514648-03b2-4c05-bf1e-78e75e393d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddde94f-b0ab-4a7f-a946-f58a837936a1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] <== disconnect_volume: return (355ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.utils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab52c7e-9908-4183-ba22-ad889dec4959]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[76854998-97e8-4047-99b9-0e9b69b5a170]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a93818-8d7f-434c-932c-5634cbc589be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494ecda-79b4-4e54-9d2f-6cd15f22945f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:44:14 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:44:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af308c-e53c-462b-9acf-110d77648555]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:44:14 user nova-compute[75266]: DEBUG os_brick.utils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:14 user nova-compute[75266]: INFO nova.compute.manager [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Swapping volume f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 for 03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:15 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'flavor' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:44:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b8080c31-0df3-44ba-8586-b1ca39d9c97e is timed out.
Nov 28 00:44:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Successfully detached device sdc from instance b8080c31-0df3-44ba-8586-b1ca39d9c97e from the live domain config.
Nov 28 00:44:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpCthIKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddea60-558f-482a-a32c-b8b2089df2c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:16 user nova-compute[75266]: No targets found.
Nov 28 00:44:16 user nova-compute[75266]: iSNS:
Nov 28 00:44:16 user nova-compute[75266]: No targets found.
Nov 28 00:44:16 user nova-compute[75266]: STATIC:
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c
Nov 28 00:44:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:16 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:16 user nova-compute[75266]: No targets found.
Nov 28 00:44:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:16 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:16 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9dd90-786b-4a47-9796-7ac111faa1c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae198d-72ee-4e6c-a289-7dbeed05cfa4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 (non-flash)
Nov 28 00:44:16 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c23f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[439dc2e8-182d-4722-b1d5-65524db801ae]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9efb66d-14cc-4cb6-941d-f8a4cce3ab9d]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0b2ec-5cf9-4543-ae88-76f609880233]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c85ed33-4e22-4faf-8abb-207582201ebc]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e0754-8ca1-44b5-9cc6-0d81ce31f3a9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232437a-3869-4bc5-a857-f7201ce279ce]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260]
Nov 28 00:44:16 user nova-compute[75266]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ed410b-6916-49f0-bb09-359798600e75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c69b948-7582-4b2b-90cb-349d6f348fa9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] <== disconnect_volume: return (442ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'flavor' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.973s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:18 user nova-compute[75266]: INFO nova.compute.manager [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Terminating instance
Nov 28 00:44:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-unplugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] No waiting events found dispatching network-vif-unplugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-unplugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Instance destroyed successfully.
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.objects.instance [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'resources' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-293684211',display_name='tempest-AttachSCSIVolumeTestJSON-server-293684211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-293684211',id=7,image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwnHKx+PiTEI0wUrFbf6lAcmNgFJf1sB96KFPtN1nsQLvuUpSP+zMzvsEQu60Iu8aCR66g+RaiF1f/PKfGhvzPotEZvGPkQ6i3IIL05YARIE+yLueZIgKDKP+kerp2PnA==',key_name='tempest-keypair-1026390778',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='616d5666496446ce828fde8a3dd0380b',ramdisk_id='',reservation_id='r-6bgcpecb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6e30adb9-4060-4751-85b1-4631c7e5b7c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1035698266',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1035698266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36df2251d9194760adcbdb9bf70ba341',uuid=b8080c31-0df3-44ba-8586-b1ca39d9c97e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converting VIF {"id": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "address": "fa:16:3e:ac:9b:f4", "network": {"id": "ec740256-41a3-4468-b79d-dd22c2713d36", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-165566072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "616d5666496446ce828fde8a3dd0380b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9537aa9-c3", "ovs_interfaceid": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_vif [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9537aa9-c3, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=098ff460-8f02-45a0-855e-bf2832612a79) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:19 user nova-compute[75266]: INFO os_vif [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:f4,bridge_name='br-int',has_traffic_filtering=True,id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c,network=Network(ec740256-41a3-4468-b79d-dd22c2713d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9537aa9-c3')
Nov 28 00:44:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Deleting instance files /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e_del
Nov 28 00:44:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Deletion of /opt/stack/data/nova/instances/b8080c31-0df3-44ba-8586-b1ca39d9c97e_del complete
Nov 28 00:44:19 user nova-compute[75266]: INFO nova.compute.manager [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86575409-89de-4408-a573-d069767ebb15 is timed out.
Nov 28 00:44:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully detached device vdb from instance 86575409-89de-4408-a573-d069767ebb15 from the live domain config.
Nov 28 00:44:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kgTumdHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:19 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e3cfa-0e0a-4e90-8032-e1f50037e7c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:19 user nova-compute[75266]: No targets found.
Nov 28 00:44:19 user nova-compute[75266]: iSNS:
Nov 28 00:44:19 user nova-compute[75266]: No targets found.
Nov 28 00:44:19 user nova-compute[75266]: STATIC:
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c
Nov 28 00:44:19 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:19 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:19 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:19 user nova-compute[75266]: No targets found.
Nov 28 00:44:19 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:19 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:19 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c0fb5-a48b-49e7-bf1e-e5eabf1e2088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[53409b26-3ef8-46ed-905a-552517ea10a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:19 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:19 user nova-compute[75266]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c (non-flash)
Nov 28 00:44:19 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bb67df2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c'): ({'sdi'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Removing single pathed devices sdi {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc9cb84-4e9b-45e3-9995-b2bfb5634630]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70e3f6-4448-4ae3-9788-44911681bc40]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Flushing IO for device /dev/sdi {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e07000-2381-4c7d-af97-8ae0f9f56692]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c6ac2-3aa2-49df-af16-1cdf58cbfe5f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[988bdc04-c17c-41ca-9607-d67d053f7290]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e1dec1-a441-452c-bae8-fe9326e281f7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260]
Nov 28 00:44:20 user nova-compute[75266]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'b8080c31-0df3-44ba-8586-b1ca39d9c97e' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b8080c31-0df3-44ba-8586-b1ca39d9c97e' (instance-00000007)
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f69d2e-08e3-4ffa-ab94-250d56a5431c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9c70c-ca9d-49f9-8920-635febba6f78]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] <== disconnect_volume: return (377ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:44:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Acquiring lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] No waiting events found dispatching network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:21 user nova-compute[75266]: WARNING nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received unexpected event network-vif-plugged-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance with vm_state active and task_state deleting.
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Received event network-vif-deleted-f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:21 user nova-compute[75266]: INFO nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Neutron deleted interface f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c; detaching it from the instance and deleting it from the info cache
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:44:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=6567MB free_disk=25.291778564453125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:21 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Took 1.59 seconds to deallocate network for instance.
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Detach interface failed, port_id=f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c, reason: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 86575409-89de-4408-a573-d069767ebb15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 46fb5677-018f-4e32-b945-166600ec6a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 51a4dd5e-3313-4c04-a699-9184465e9895 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 2619f610-3a3c-4b48-9448-c30d75414e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.428s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "interface-86575409-89de-4408-a573-d069767ebb15-cb19ffde-74b9-41c3-9577-eb9064e539a6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "interface-86575409-89de-4408-a573-d069767ebb15-cb19ffde-74b9-41c3-9577-eb9064e539a6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Attempting to detach device tapcb19ffde-74 from instance 86575409-89de-4408-a573-d069767ebb15 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] detach device xml: <interface type="ethernet">
Nov 28 00:44:21 user nova-compute[75266]:   <mac address="fa:16:3e:dd:27:ce"/>
Nov 28 00:44:21 user nova-compute[75266]:   <model type="virtio"/>
Nov 28 00:44:21 user nova-compute[75266]:   <mtu size="1442"/>
Nov 28 00:44:21 user nova-compute[75266]:   <target dev="tapcb19ffde-74"/>
Nov 28 00:44:21 user nova-compute[75266]: </interface>
Nov 28 00:44:21 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 00:44:21 user nova-compute[75266]:   <name>instance-00000008</name>
Nov 28 00:44:21 user nova-compute[75266]:   <uuid>86575409-89de-4408-a573-d069767ebb15</uuid>
Nov 28 00:44:21 user nova-compute[75266]:   <metadata>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:21 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:43:46</nova:creationTime>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:21 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:21 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:21 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:21 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:21 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:21 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:21 user nova-compute[75266]:     <nova:port uuid="cb19ffde-74b9-41c3-9577-eb9064e539a6">
Nov 28 00:44:21 user nova-compute[75266]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Nov 28 00:44:21 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:21 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:21 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:21 user nova-compute[75266]:   </metadata>
Nov 28 00:44:21 user nova-compute[75266]:   <memory unit='KiB'>524288</memory>
Nov 28 00:44:21 user nova-compute[75266]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 00:44:21 user nova-compute[75266]:   <vcpu placement='static'>1</vcpu>
Nov 28 00:44:21 user nova-compute[75266]:   <resource>
Nov 28 00:44:21 user nova-compute[75266]:     <partition>/machine</partition>
Nov 28 00:44:21 user nova-compute[75266]:   </resource>
Nov 28 00:44:21 user nova-compute[75266]:   <sysinfo type='smbios'>
Nov 28 00:44:21 user nova-compute[75266]:     <system>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='version'>0.0.0</entry>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='serial'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='uuid'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:21 user nova-compute[75266]:       <entry name='family'>Virtual Machine</entry>
Nov 28 00:44:21 user nova-compute[75266]:     </system>
Nov 28 00:44:21 user nova-compute[75266]:   </sysinfo>
Nov 28 00:44:21 user nova-compute[75266]:   <os>
Nov 28 00:44:21 user nova-compute[75266]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 00:44:21 user nova-compute[75266]:     <boot dev='hd'/>
Nov 28 00:44:21 user nova-compute[75266]:     <smbios mode='sysinfo'/>
Nov 28 00:44:21 user nova-compute[75266]:   </os>
Nov 28 00:44:21 user nova-compute[75266]:   <features>
Nov 28 00:44:21 user nova-compute[75266]:     <acpi/>
Nov 28 00:44:21 user nova-compute[75266]:     <apic/>
Nov 28 00:44:21 user nova-compute[75266]:     <vmcoreinfo state='on'/>
Nov 28 00:44:21 user nova-compute[75266]:   </features>
Nov 28 00:44:21 user nova-compute[75266]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 00:44:21 user nova-compute[75266]:     <model fallback='forbid'>Nehalem</model>
Nov 28 00:44:21 user nova-compute[75266]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 00:44:21 user nova-compute[75266]:     <feature policy='require' name='vme'/>
Nov 28 00:44:21 user nova-compute[75266]:     <feature policy='require' name='x2apic'/>
Nov 28 00:44:21 user nova-compute[75266]:     <feature policy='require' name='hypervisor'/>
Nov 28 00:44:21 user nova-compute[75266]:   </cpu>
Nov 28 00:44:21 user nova-compute[75266]:   <clock offset='utc'>
Nov 28 00:44:21 user nova-compute[75266]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 00:44:21 user nova-compute[75266]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 00:44:21 user nova-compute[75266]:     <timer name='hpet' present='no'/>
Nov 28 00:44:21 user nova-compute[75266]:   </clock>
Nov 28 00:44:21 user nova-compute[75266]:   <on_poweroff>destroy</on_poweroff>
Nov 28 00:44:21 user nova-compute[75266]:   <on_reboot>restart</on_reboot>
Nov 28 00:44:21 user nova-compute[75266]:   <on_crash>destroy</on_crash>
Nov 28 00:44:21 user nova-compute[75266]:   <devices>
Nov 28 00:44:21 user nova-compute[75266]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 00:44:21 user nova-compute[75266]:     <disk type='file' device='disk'>
Nov 28 00:44:21 user nova-compute[75266]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 00:44:21 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk' index='2'/>
Nov 28 00:44:21 user nova-compute[75266]:       <backingStore type='file' index='3'>
Nov 28 00:44:21 user nova-compute[75266]:         <format type='raw'/>
Nov 28 00:44:21 user nova-compute[75266]:         <source file='/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822'/>
Nov 28 00:44:21 user nova-compute[75266]:         <backingStore/>
Nov 28 00:44:21 user nova-compute[75266]:       </backingStore>
Nov 28 00:44:21 user nova-compute[75266]:       <target dev='vda' bus='virtio'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='virtio-disk0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </disk>
Nov 28 00:44:21 user nova-compute[75266]:     <disk type='file' device='cdrom'>
Nov 28 00:44:21 user nova-compute[75266]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 00:44:21 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config' index='1'/>
Nov 28 00:44:21 user nova-compute[75266]:       <backingStore/>
Nov 28 00:44:21 user nova-compute[75266]:       <target dev='hda' bus='ide'/>
Nov 28 00:44:21 user nova-compute[75266]:       <readonly/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='ide0-0-0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </disk>
Nov 28 00:44:21 user nova-compute[75266]:     <controller type='usb' index='0' model='none'>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='usb'/>
Nov 28 00:44:21 user nova-compute[75266]:     </controller>
Nov 28 00:44:21 user nova-compute[75266]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='pci.0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </controller>
Nov 28 00:44:21 user nova-compute[75266]:     <controller type='ide' index='0'>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='ide'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 00:44:21 user nova-compute[75266]:     </controller>
Nov 28 00:44:21 user nova-compute[75266]:     <interface type='ethernet'>
Nov 28 00:44:21 user nova-compute[75266]:       <mac address='fa:16:3e:bb:af:f2'/>
Nov 28 00:44:21 user nova-compute[75266]:       <target dev='tap734679ea-80'/>
Nov 28 00:44:21 user nova-compute[75266]:       <model type='virtio'/>
Nov 28 00:44:21 user nova-compute[75266]:       <mtu size='1442'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='net0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </interface>
Nov 28 00:44:21 user nova-compute[75266]:     <interface type='ethernet'>
Nov 28 00:44:21 user nova-compute[75266]:       <mac address='fa:16:3e:dd:27:ce'/>
Nov 28 00:44:21 user nova-compute[75266]:       <target dev='tapcb19ffde-74'/>
Nov 28 00:44:21 user nova-compute[75266]:       <model type='virtio'/>
Nov 28 00:44:21 user nova-compute[75266]:       <mtu size='1442'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='net1'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </interface>
Nov 28 00:44:21 user nova-compute[75266]:     <serial type='pty'>
Nov 28 00:44:21 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:21 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:21 user nova-compute[75266]:       <target type='isa-serial' port='0'>
Nov 28 00:44:21 user nova-compute[75266]:         <model name='isa-serial'/>
Nov 28 00:44:21 user nova-compute[75266]:       </target>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </serial>
Nov 28 00:44:21 user nova-compute[75266]:     <console type='pty' tty='/dev/pts/6'>
Nov 28 00:44:21 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:21 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:21 user nova-compute[75266]:       <target type='serial' port='0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </console>
Nov 28 00:44:21 user nova-compute[75266]:     <input type='mouse' bus='ps2'>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='input0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </input>
Nov 28 00:44:21 user nova-compute[75266]:     <input type='keyboard' bus='ps2'>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='input1'/>
Nov 28 00:44:21 user nova-compute[75266]:     </input>
Nov 28 00:44:21 user nova-compute[75266]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 28 00:44:21 user nova-compute[75266]:       <listen type='address' address='0.0.0.0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </graphics>
Nov 28 00:44:21 user nova-compute[75266]:     <audio id='1' type='none'/>
Nov 28 00:44:21 user nova-compute[75266]:     <video>
Nov 28 00:44:21 user nova-compute[75266]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='video0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </video>
Nov 28 00:44:21 user nova-compute[75266]:     <memballoon model='virtio'>
Nov 28 00:44:21 user nova-compute[75266]:       <stats period='10'/>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='balloon0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </memballoon>
Nov 28 00:44:21 user nova-compute[75266]:     <rng model='virtio'>
Nov 28 00:44:21 user nova-compute[75266]:       <backend model='random'>/dev/urandom</backend>
Nov 28 00:44:21 user nova-compute[75266]:       <alias name='rng0'/>
Nov 28 00:44:21 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 00:44:21 user nova-compute[75266]:     </rng>
Nov 28 00:44:21 user nova-compute[75266]:   </devices>
Nov 28 00:44:21 user nova-compute[75266]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 00:44:21 user nova-compute[75266]:     <label>libvirt-86575409-89de-4408-a573-d069767ebb15</label>
Nov 28 00:44:21 user nova-compute[75266]:     <imagelabel>libvirt-86575409-89de-4408-a573-d069767ebb15</imagelabel>
Nov 28 00:44:21 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:21 user nova-compute[75266]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 00:44:21 user nova-compute[75266]:     <label>+64055:+108</label>
Nov 28 00:44:21 user nova-compute[75266]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 00:44:21 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:21 user nova-compute[75266]: </domain>
Nov 28 00:44:21 user nova-compute[75266]:  {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 00:44:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully detached device tapcb19ffde-74 from instance 86575409-89de-4408-a573-d069767ebb15 from the persistent domain config.
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] (1/8): Attempting to detach device tapcb19ffde-74 with device alias net1 from instance 86575409-89de-4408-a573-d069767ebb15 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:44:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] detach device xml: <interface type="ethernet">
Nov 28 00:44:21 user nova-compute[75266]:   <mac address="fa:16:3e:dd:27:ce"/>
Nov 28 00:44:21 user nova-compute[75266]:   <model type="virtio"/>
Nov 28 00:44:21 user nova-compute[75266]:   <mtu size="1442"/>
Nov 28 00:44:21 user nova-compute[75266]:   <target dev="tapcb19ffde-74"/>
Nov 28 00:44:21 user nova-compute[75266]: </interface>
Nov 28 00:44:21 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:22 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Deleted allocations for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "b8080c31-0df3-44ba-8586-b1ca39d9c97e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.660s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Start waiting for the detach event from libvirt for device tapcb19ffde-74 with device alias net1 for instance 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': '03ee4663-c44a-45b0-8721-f33b791fcbbf', 'serial': '03ee4663-c44a-45b0-8721-f33b791fcbbf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24'}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'serial'} {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:22 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:22 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:22 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf898f5-fa0f-4c1c-ac31-dc9957039d27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:44:22 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483a039-897a-44c5-83e9-edaeebb64ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf] added
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[852644b3-fb8c-42b3-be25-6a787d1e51ce]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61c8b6-1c22-4202-afb9-b89b6b28e719]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQGChzrR {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQGChzrR" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48d9dc-0ace-4d29-af71-ac76a19484fc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQGChzrR'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[57151f75-b6a5-43fa-a695-2ec277d1de8f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25784e53-72b3-47af-b356-cf8f04a5a738]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0e68c-27a6-4d35-81e5-256d7cf19f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]
Nov 28 00:44:22 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8de680-e637-45e6-aa7c-4addd3e3f80a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb808ae-9e2e-4d4b-a641-974c2beaaea0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65defab-737e-4671-99ad-13fce71e2769]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:44:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-unplugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-unplugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:23 user nova-compute[75266]: WARNING nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-unplugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance with vm_state active and task_state None.
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:23 user nova-compute[75266]: WARNING nova.compute.manager [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance with vm_state active and task_state None.
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26665613031663239', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665613031663239', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:44:23 user nova-compute[75266]: DEBUG nova.objects.instance [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lazy-loading 'flavor' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 305135616 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:25 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 is timed out.
Nov 28 00:44:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Successfully detached device vdb from instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 from the live domain config.
Nov 28 00:44:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPgSiwsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:25 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb44241-2132-476c-acff-f298f8a561cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:25 user nova-compute[75266]: No targets found.
Nov 28 00:44:25 user nova-compute[75266]: iSNS:
Nov 28 00:44:25 user nova-compute[75266]: No targets found.
Nov 28 00:44:25 user nova-compute[75266]: STATIC:
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:25 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:25 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:25 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:25 user nova-compute[75266]: No targets found.
Nov 28 00:44:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:25 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:25 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598e19c-4179-4c68-a333-a1ab9a36f12d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe736e-41ba-4458-ac22-247ce11fa6b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c57fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae'): ({'sdj'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Removing single pathed devices sdj {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 467664896 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7465c41e-eb91-4fa6-9318-2d30b14c0f0a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb2825-9a82-4522-bb59-d96576d76253]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Flushing IO for device /dev/sdj {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4319d-b14e-43a9-8b47-e15584d55a1c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c80f1c-3329-417a-92cb-f6d15bad1d5f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] SCSI volumes sdj have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc22f44-2541-462a-9661-22b5724f4b3c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac5237-70c9-43db-8802-166a65525e40]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260]
Nov 28 00:44:26 user nova-compute[75266]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7afd95d-540d-416f-bf05-2720e4123cae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb23d7-3d4b-44af-881f-563a821b9ec7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] <== disconnect_volume: return (381ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 719323136 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:27 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lazy-loading 'flavor' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.065s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxaleiud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:28 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[300d88d4-7d55-4f6d-8416-e55cec01b60b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:28 user nova-compute[75266]: No targets found.
Nov 28 00:44:28 user nova-compute[75266]: iSNS:
Nov 28 00:44:28 user nova-compute[75266]: No targets found.
Nov 28 00:44:28 user nova-compute[75266]: STATIC:
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:28 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:28 user nova-compute[75266]: No targets found.
Nov 28 00:44:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:28 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:28 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f24bc13-84a8-400b-bc6b-677f61d61f27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae727c7-ac5a-44f4-b3c1-a56271587652]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bb6ac67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24'): ({'sdk'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Removing single pathed devices sdk {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd55b5-f902-4d68-b067-a343b67429ec]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d123f-045c-43a2-b440-ab2fbe3b91b8]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Flushing IO for device /dev/sdk {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7afcac-aa67-4acc-90a8-b65d158bdd5b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31819d3-8086-4e76-b237-f81157047f64]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] SCSI volumes sdk have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0c204-0e54-4cf0-b908-550225dcb3ef]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de10ee-b5ae-4d08-9604-50ca3597c03b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260]
Nov 28 00:44:28 user nova-compute[75266]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b4b86-d220-4b7f-a10c-ac895104181a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] <== disconnect_volume: return (385ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '46fb5677-018f-4e32-b945-166600ec6a24', 'attached_at': '', 'detached_at': '', 'volume_id': '03ee4663-c44a-45b0-8721-f33b791fcbbf', 'serial'} {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 00:44:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: removing Cinder connection for volume f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 {{(pid=75266) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 00:44:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] swap_volume: Updating volume f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "gQGChzrR", "auth_password": "iHYDIhljKCJWNB", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "03ee4663-c44a-45b0-8721-f33b791fcbbf"}, "status": "reserved", "instance": "46fb5677-018f-4e32-b945-166600ec6a24", "attached_at": "", "detached_at": "", "volume_id": "03ee4663-c44a-45b0-8721-f33b791fcbbf", "serial": "03ee4663-c44a-45b0-8721-f33b791fcbbf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '03ee4663-c44a-45b0-8721-f33b791fcbbf', 'no_device': None, 'attachment_id': '31fa1547-c34e-42fc-a3ff-3f9de53d037d'} {{(pid=75266) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 00:44:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.753s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:30 user nova-compute[75266]: INFO nova.compute.manager [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Detaching volume 03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:30 user nova-compute[75266]: INFO nova.virt.block_device [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Attempting to driver detach volume 03ee4663-c44a-45b0-8721-f33b791fcbbf from mountpoint /dev/vdb
Nov 28 00:44:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Attempting to detach device vdb from instance 46fb5677-018f-4e32-b945-166600ec6a24 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:44:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:44:30 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:44:30 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:44:30 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:44:30 user nova-compute[75266]:   <serial>03ee4663-c44a-45b0-8721-f33b791fcbbf</serial>
Nov 28 00:44:30 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:44:30 user nova-compute[75266]: </disk>
Nov 28 00:44:30 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Successfully detached device vdb from instance 46fb5677-018f-4e32-b945-166600ec6a24 from the persistent domain config.
Nov 28 00:44:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46fb5677-018f-4e32-b945-166600ec6a24 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:44:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:44:30 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:44:30 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:44:30 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:44:30 user nova-compute[75266]:   <serial>03ee4663-c44a-45b0-8721-f33b791fcbbf</serial>
Nov 28 00:44:30 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:44:30 user nova-compute[75266]: </disk>
Nov 28 00:44:30 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:44:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-changed-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing instance network info cache due to event network-changed-b4b1bb66-214e-4774-96ca-91634121b5d5. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Acquiring lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Acquired lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Refreshing network info cache for port b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updated VIF entry in instance network info cache for port b4b1bb66-214e-4774-96ca-91634121b5d5. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Releasing lock "refresh_cache-51a4dd5e-3313-4c04-a699-9184465e9895" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:36 user nova-compute[75266]: INFO nova.compute.manager [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Terminating instance
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-b4b1bb66-214e-4774-96ca-91634121b5d5 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-03619394-6a6e-497d-b570-4a288cdcd6f7 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Instance destroyed successfully.
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.objects.instance [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lazy-loading 'resources' on Instance uuid 51a4dd5e-3313-4c04-a699-9184465e9895 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4b1bb66-21, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f1f0253-0ac4-4322-9128-4caf9cb4aaa9) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:b3:27,bridge_name='br-int',has_traffic_filtering=True,id=b4b1bb66-214e-4774-96ca-91634121b5d5,network=Network(e9199b7a-6370-4897-b5f7-76cfd7236904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b1bb66-21')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03619394-6a, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=240537e6-a65d-47c4-975c-4800305c783c) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:29,bridge_name='br-int',has_traffic_filtering=True,id=03619394-6a6e-497d-b570-4a288cdcd6f7,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03619394-6a')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12d80f85-36, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a30bd454-263e-47c0-808d-e4135a77dd09) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:5b:e7,bridge_name='br-int',has_traffic_filtering=True,id=12d80f85-36dc-495d-9e2a-47ccaeafe267,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12d80f85-36')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93942af8-67, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b376f3c5-4484-4e13-8aa6-73ed2b30b0ad) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: WARNING nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-b4b1bb66-214e-4774-96ca-91634121b5d5 for instance with vm_state active and task_state deleting.
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: WARNING nova.compute.manager [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance with vm_state active and task_state deleting.
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ee:94,bridge_name='br-int',has_traffic_filtering=True,id=93942af8-6733-4aa8-ab7a-6306b5196f30,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93942af8-67')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6ea4af3-eb, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=833bb37b-28ab-4961-8e29-6256b16f585c) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:3f:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ea4af3-eb88-4c03-a3bf-c852a8464e52,network=Network(62e0d794-1ae9-4b26-8244-1d9b5a5e2683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ea4af3-eb')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b322b03-7a, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fe3576c-0507-4e6e-aea9-ad74107529bd) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:aa,bridge_name='br-int',has_traffic_filtering=True,id=6b322b03-7a4e-4a72-8a3d-3cc3a485f801,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b322b03-7a')
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:42:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-222609210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-222609210',id=11,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw==',key_name='tempest-keypair-452999819',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a0f37585d44cc6a8f14651c74869c8',ramdisk_id='',reservation_id='r-t4ju2mni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2102994287',owner_user_name='tempest-TaggedBootDevicesTest-2102994287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c110bc80f8fa44f6863d2ebe961d2510',uuid=51a4dd5e-3313-4c04-a699-9184465e9895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converting VIF {"id": "c986d58d-26af-42f2-b152-4e31e6403c2c", "address": "fa:16:3e:bd:67:39", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc986d58d-26", "ovs_interfaceid": "c986d58d-26af-42f2-b152-4e31e6403c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc986d58d-26, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: WARNING nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-03619394-6a6e-497d-b570-4a288cdcd6f7 for instance with vm_state active and task_state deleting.
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-93942af8-6733-4aa8-ab7a-6306b5196f30 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:38 user nova-compute[75266]: WARNING nova.compute.manager [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-93942af8-6733-4aa8-ab7a-6306b5196f30 for instance with vm_state active and task_state deleting.
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f80f565-da19-48cb-995a-49ee9d1eae9d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance with vm_state active and task_state deleting.
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance with vm_state active and task_state deleting.
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-unplugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-unplugged-c986d58d-26af-42f2-b152-4e31e6403c2c for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "51a4dd5e-3313-4c04-a699-9184465e9895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] No waiting events found dispatching network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING nova.compute.manager [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received unexpected event network-vif-plugged-c986d58d-26af-42f2-b152-4e31e6403c2c for instance with vm_state active and task_state deleting.
Nov 28 00:44:39 user nova-compute[75266]: INFO os_vif [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:67:39,bridge_name='br-int',has_traffic_filtering=True,id=c986d58d-26af-42f2-b152-4e31e6403c2c,network=Network(dfba0188-78f7-4ef0-a411-0b8b98e093a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc986d58d-26')
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjGNHuvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaad20f-37ba-4b4b-85aa-883942154ac0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: iSNS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: STATIC:
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ebfc17-9859-42c4-85e7-496109f174b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d4065-d79c-446b-be9e-5125a41c25de]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c438670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[16db6896-83e2-4119-8853-a686a642eb75]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[867244af-55cf-442c-9f50-f02a8478e337]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e383556-bc77-44ae-baf5-d9d48cdcf927]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e8f80-436b-446a-abac-778b8f13fc40]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ef747-bc1e-4a0c-b489-5770d8178780]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3d784-a432-472d-ad7a-4aa91cbd2ea5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260]
Nov 28 00:44:39 user nova-compute[75266]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52865390-32c6-476c-b67a-61116319990f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd47da-ec76-4ecf-a5a3-18bdce83e22a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== disconnect_volume: return (314ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EkojhOIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3e521-6ec9-411f-987f-7b2f70ea9c8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: iSNS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: STATIC:
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[057be96c-7fae-4d5d-a7f0-72c43a8e8ca3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265f12f-c9c1-4610-8810-9cb90b74ca9a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada3a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726f84a-11c0-4cb4-9e07-f2b1d30a365b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a105c5-9807-4b87-99e9-404a9b1c20ec]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ede3c-9222-434b-9270-8614779ed763]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebb7d8-3a3b-476e-b73e-45f63d100d09]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c61c96-114d-42c7-a093-7ac7ff875131]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e295e7-492b-42bf-a858-6ac37ac3962f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260]
Nov 28 00:44:39 user nova-compute[75266]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6685b5b0-ebeb-4499-80de-9a81996811db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd314d76-d3fa-44d0-bfef-6847b1a0211e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== disconnect_volume: return (305ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNgKcIGJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb66c1-e897-4865-b4b3-8b948dfad123]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: iSNS:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]: STATIC:
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:39 user nova-compute[75266]: No targets found.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[74695d31-00f9-48bc-be95-f430ba222369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f85c74-e24b-40fe-b058-075237a2f641]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada3a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb58af1-78f7-4c22-ba7a-61f1b51c7a1a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd63a8-c0cb-4f4c-a788-b7ec06755950]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80325a3-bd75-41ff-a5b4-3d4ad90356e8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc0b9f-3ccf-4db2-afaa-6ae3ef5c1a4f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f16f5-02f9-4bc8-8c0a-0be994c605e0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825e151-8358-497a-895b-8e91d6f1fb5b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260]
Nov 28 00:44:39 user nova-compute[75266]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b6b19a4-9b37-451a-a517-92a140e6c9f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[919db804-1fdb-4fa2-ab60-7a71b1b90020]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] <== disconnect_volume: return (321ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Deleting instance files /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895_del
Nov 28 00:44:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Deletion of /opt/stack/data/nova/instances/51a4dd5e-3313-4c04-a699-9184465e9895_del complete
Nov 28 00:44:40 user nova-compute[75266]: INFO nova.compute.manager [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Took 3.64 seconds to destroy the instance on the hypervisor.
Nov 28 00:44:40 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:44:40 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:44:40 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:44:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-deleted-c986d58d-26af-42f2-b152-4e31e6403c2c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:41 user nova-compute[75266]: INFO nova.compute.manager [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Neutron deleted interface c986d58d-26af-42f2-b152-4e31e6403c2c; detaching it from the instance and deleting it from the info cache
Nov 28 00:44:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [{"id": "b4b1bb66-214e-4774-96ca-91634121b5d5", "address": "fa:16:3e:6f:b3:27", "network": {"id": "e9199b7a-6370-4897-b5f7-76cfd7236904", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-417116764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b1bb66-21", "ovs_interfaceid": "b4b1bb66-214e-4774-96ca-91634121b5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03619394-6a6e-497d-b570-4a288cdcd6f7", "address": "fa:16:3e:6e:25:29", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03619394-6a", "ovs_interfaceid": "03619394-6a6e-497d-b570-4a288cdcd6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "address": "fa:16:3e:08:5b:e7", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d80f85-36", "ovs_interfaceid": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93942af8-6733-4aa8-ab7a-6306b5196f30", "address": "fa:16:3e:62:ee:94", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93942af8-67", "ovs_interfaceid": "93942af8-6733-4aa8-ab7a-6306b5196f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "address": "fa:16:3e:53:3f:fd", "network": {"id": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "bridge": "br-int", "label": "tempest-device-tagging-net1-106657697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ea4af3-eb", "ovs_interfaceid": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "address": "fa:16:3e:af:99:aa", "network": {"id": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2133738554", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a0f37585d44cc6a8f14651c74869c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b322b03-7a", "ovs_interfaceid": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Detach interface failed, port_id=c986d58d-26af-42f2-b152-4e31e6403c2c, reason: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:44:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Waiting for libvirt event about the detach of device tapcb19ffde-74 with device alias net1 from instance 86575409-89de-4408-a573-d069767ebb15 is timed out.
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 00:44:42 user nova-compute[75266]:   <name>instance-00000008</name>
Nov 28 00:44:42 user nova-compute[75266]:   <uuid>86575409-89de-4408-a573-d069767ebb15</uuid>
Nov 28 00:44:42 user nova-compute[75266]:   <metadata>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:42 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:43:46</nova:creationTime>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:42 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:42 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:42 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:port uuid="cb19ffde-74b9-41c3-9577-eb9064e539a6">
Nov 28 00:44:42 user nova-compute[75266]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Nov 28 00:44:42 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:42 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:42 user nova-compute[75266]:   </metadata>
Nov 28 00:44:42 user nova-compute[75266]:   <memory unit='KiB'>524288</memory>
Nov 28 00:44:42 user nova-compute[75266]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 00:44:42 user nova-compute[75266]:   <vcpu placement='static'>1</vcpu>
Nov 28 00:44:42 user nova-compute[75266]:   <resource>
Nov 28 00:44:42 user nova-compute[75266]:     <partition>/machine</partition>
Nov 28 00:44:42 user nova-compute[75266]:   </resource>
Nov 28 00:44:42 user nova-compute[75266]:   <sysinfo type='smbios'>
Nov 28 00:44:42 user nova-compute[75266]:     <system>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='version'>0.0.0</entry>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='serial'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='uuid'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:42 user nova-compute[75266]:       <entry name='family'>Virtual Machine</entry>
Nov 28 00:44:42 user nova-compute[75266]:     </system>
Nov 28 00:44:42 user nova-compute[75266]:   </sysinfo>
Nov 28 00:44:42 user nova-compute[75266]:   <os>
Nov 28 00:44:42 user nova-compute[75266]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 00:44:42 user nova-compute[75266]:     <boot dev='hd'/>
Nov 28 00:44:42 user nova-compute[75266]:     <smbios mode='sysinfo'/>
Nov 28 00:44:42 user nova-compute[75266]:   </os>
Nov 28 00:44:42 user nova-compute[75266]:   <features>
Nov 28 00:44:42 user nova-compute[75266]:     <acpi/>
Nov 28 00:44:42 user nova-compute[75266]:     <apic/>
Nov 28 00:44:42 user nova-compute[75266]:     <vmcoreinfo state='on'/>
Nov 28 00:44:42 user nova-compute[75266]:   </features>
Nov 28 00:44:42 user nova-compute[75266]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 00:44:42 user nova-compute[75266]:     <model fallback='forbid'>Nehalem</model>
Nov 28 00:44:42 user nova-compute[75266]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 00:44:42 user nova-compute[75266]:     <feature policy='require' name='vme'/>
Nov 28 00:44:42 user nova-compute[75266]:     <feature policy='require' name='x2apic'/>
Nov 28 00:44:42 user nova-compute[75266]:     <feature policy='require' name='hypervisor'/>
Nov 28 00:44:42 user nova-compute[75266]:   </cpu>
Nov 28 00:44:42 user nova-compute[75266]:   <clock offset='utc'>
Nov 28 00:44:42 user nova-compute[75266]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 00:44:42 user nova-compute[75266]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 00:44:42 user nova-compute[75266]:     <timer name='hpet' present='no'/>
Nov 28 00:44:42 user nova-compute[75266]:   </clock>
Nov 28 00:44:42 user nova-compute[75266]:   <on_poweroff>destroy</on_poweroff>
Nov 28 00:44:42 user nova-compute[75266]:   <on_reboot>restart</on_reboot>
Nov 28 00:44:42 user nova-compute[75266]:   <on_crash>destroy</on_crash>
Nov 28 00:44:42 user nova-compute[75266]:   <devices>
Nov 28 00:44:42 user nova-compute[75266]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 00:44:42 user nova-compute[75266]:     <disk type='file' device='disk'>
Nov 28 00:44:42 user nova-compute[75266]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 00:44:42 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk' index='2'/>
Nov 28 00:44:42 user nova-compute[75266]:       <backingStore type='file' index='3'>
Nov 28 00:44:42 user nova-compute[75266]:         <format type='raw'/>
Nov 28 00:44:42 user nova-compute[75266]:         <source file='/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822'/>
Nov 28 00:44:42 user nova-compute[75266]:         <backingStore/>
Nov 28 00:44:42 user nova-compute[75266]:       </backingStore>
Nov 28 00:44:42 user nova-compute[75266]:       <target dev='vda' bus='virtio'/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='virtio-disk0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </disk>
Nov 28 00:44:42 user nova-compute[75266]:     <disk type='file' device='cdrom'>
Nov 28 00:44:42 user nova-compute[75266]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 00:44:42 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config' index='1'/>
Nov 28 00:44:42 user nova-compute[75266]:       <backingStore/>
Nov 28 00:44:42 user nova-compute[75266]:       <target dev='hda' bus='ide'/>
Nov 28 00:44:42 user nova-compute[75266]:       <readonly/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='ide0-0-0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </disk>
Nov 28 00:44:42 user nova-compute[75266]:     <controller type='usb' index='0' model='none'>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='usb'/>
Nov 28 00:44:42 user nova-compute[75266]:     </controller>
Nov 28 00:44:42 user nova-compute[75266]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='pci.0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </controller>
Nov 28 00:44:42 user nova-compute[75266]:     <controller type='ide' index='0'>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='ide'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 00:44:42 user nova-compute[75266]:     </controller>
Nov 28 00:44:42 user nova-compute[75266]:     <interface type='ethernet'>
Nov 28 00:44:42 user nova-compute[75266]:       <mac address='fa:16:3e:bb:af:f2'/>
Nov 28 00:44:42 user nova-compute[75266]:       <target dev='tap734679ea-80'/>
Nov 28 00:44:42 user nova-compute[75266]:       <model type='virtio'/>
Nov 28 00:44:42 user nova-compute[75266]:       <mtu size='1442'/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='net0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </interface>
Nov 28 00:44:42 user nova-compute[75266]:     <serial type='pty'>
Nov 28 00:44:42 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:42 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:42 user nova-compute[75266]:       <target type='isa-serial' port='0'>
Nov 28 00:44:42 user nova-compute[75266]:         <model name='isa-serial'/>
Nov 28 00:44:42 user nova-compute[75266]:       </target>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </serial>
Nov 28 00:44:42 user nova-compute[75266]:     <console type='pty' tty='/dev/pts/6'>
Nov 28 00:44:42 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:42 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:42 user nova-compute[75266]:       <target type='serial' port='0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </console>
Nov 28 00:44:42 user nova-compute[75266]:     <input type='mouse' bus='ps2'>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='input0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </input>
Nov 28 00:44:42 user nova-compute[75266]:     <input type='keyboard' bus='ps2'>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='input1'/>
Nov 28 00:44:42 user nova-compute[75266]:     </input>
Nov 28 00:44:42 user nova-compute[75266]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 28 00:44:42 user nova-compute[75266]:       <listen type='address' address='0.0.0.0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </graphics>
Nov 28 00:44:42 user nova-compute[75266]:     <audio id='1' type='none'/>
Nov 28 00:44:42 user nova-compute[75266]:     <video>
Nov 28 00:44:42 user nova-compute[75266]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='video0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </video>
Nov 28 00:44:42 user nova-compute[75266]:     <memballoon model='virtio'>
Nov 28 00:44:42 user nova-compute[75266]:       <stats period='10'/>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='balloon0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </memballoon>
Nov 28 00:44:42 user nova-compute[75266]:     <rng model='virtio'>
Nov 28 00:44:42 user nova-compute[75266]:       <backend model='random'>/dev/urandom</backend>
Nov 28 00:44:42 user nova-compute[75266]:       <alias name='rng0'/>
Nov 28 00:44:42 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 00:44:42 user nova-compute[75266]:     </rng>
Nov 28 00:44:42 user nova-compute[75266]:   </devices>
Nov 28 00:44:42 user nova-compute[75266]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 00:44:42 user nova-compute[75266]:     <label>libvirt-86575409-89de-4408-a573-d069767ebb15</label>
Nov 28 00:44:42 user nova-compute[75266]:     <imagelabel>libvirt-86575409-89de-4408-a573-d069767ebb15</imagelabel>
Nov 28 00:44:42 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:42 user nova-compute[75266]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 00:44:42 user nova-compute[75266]:     <label>+64055:+108</label>
Nov 28 00:44:42 user nova-compute[75266]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 00:44:42 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:42 user nova-compute[75266]: </domain>
Nov 28 00:44:42 user nova-compute[75266]:  {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 00:44:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully detached device tapcb19ffde-74 from instance 86575409-89de-4408-a573-d069767ebb15 from the live domain config.
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG os_vif [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb19ffde-74, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24b1785a-a8d2-4eec-9efd-f437f5df8ac9) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:42 user nova-compute[75266]: INFO os_vif [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74')
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:42 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:44:42</nova:creationTime>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:42 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:42 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:42 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:42 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:42 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:42 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:42 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:42 user nova-compute[75266]:  {{(pid=75266) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 00:44:42 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:42 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Took 2.81 seconds to deallocate network for instance.
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-deleted-cb19ffde-74b9-41c3-9577-eb9064e539a6 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:43 user nova-compute[75266]: INFO nova.compute.manager [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Neutron deleted interface cb19ffde-74b9-41c3-9577-eb9064e539a6; detaching it from the instance and deleting it from the info cache
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquired lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.objects.instance [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Lazy-loading 'system_metadata' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.objects.instance [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Lazy-loading 'flavor' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.objects.base [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Object Instance<86575409-89de-4408-a573-d069767ebb15> lazy-loaded attributes: system_metadata,flavor {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 00:44:43 user nova-compute[75266]:   <name>instance-00000008</name>
Nov 28 00:44:43 user nova-compute[75266]:   <uuid>86575409-89de-4408-a573-d069767ebb15</uuid>
Nov 28 00:44:43 user nova-compute[75266]:   <metadata>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:43 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:44:42</nova:creationTime>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:43 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:43 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:43 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:43 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:43 user nova-compute[75266]:   </metadata>
Nov 28 00:44:43 user nova-compute[75266]:   <memory unit='KiB'>524288</memory>
Nov 28 00:44:43 user nova-compute[75266]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 00:44:43 user nova-compute[75266]:   <vcpu placement='static'>1</vcpu>
Nov 28 00:44:43 user nova-compute[75266]:   <resource>
Nov 28 00:44:43 user nova-compute[75266]:     <partition>/machine</partition>
Nov 28 00:44:43 user nova-compute[75266]:   </resource>
Nov 28 00:44:43 user nova-compute[75266]:   <sysinfo type='smbios'>
Nov 28 00:44:43 user nova-compute[75266]:     <system>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='version'>0.0.0</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='serial'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='uuid'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='family'>Virtual Machine</entry>
Nov 28 00:44:43 user nova-compute[75266]:     </system>
Nov 28 00:44:43 user nova-compute[75266]:   </sysinfo>
Nov 28 00:44:43 user nova-compute[75266]:   <os>
Nov 28 00:44:43 user nova-compute[75266]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 00:44:43 user nova-compute[75266]:     <boot dev='hd'/>
Nov 28 00:44:43 user nova-compute[75266]:     <smbios mode='sysinfo'/>
Nov 28 00:44:43 user nova-compute[75266]:   </os>
Nov 28 00:44:43 user nova-compute[75266]:   <features>
Nov 28 00:44:43 user nova-compute[75266]:     <acpi/>
Nov 28 00:44:43 user nova-compute[75266]:     <apic/>
Nov 28 00:44:43 user nova-compute[75266]:     <vmcoreinfo state='on'/>
Nov 28 00:44:43 user nova-compute[75266]:   </features>
Nov 28 00:44:43 user nova-compute[75266]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 00:44:43 user nova-compute[75266]:     <model fallback='forbid'>Nehalem</model>
Nov 28 00:44:43 user nova-compute[75266]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='vme'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='x2apic'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='hypervisor'/>
Nov 28 00:44:43 user nova-compute[75266]:   </cpu>
Nov 28 00:44:43 user nova-compute[75266]:   <clock offset='utc'>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='hpet' present='no'/>
Nov 28 00:44:43 user nova-compute[75266]:   </clock>
Nov 28 00:44:43 user nova-compute[75266]:   <on_poweroff>destroy</on_poweroff>
Nov 28 00:44:43 user nova-compute[75266]:   <on_reboot>restart</on_reboot>
Nov 28 00:44:43 user nova-compute[75266]:   <on_crash>destroy</on_crash>
Nov 28 00:44:43 user nova-compute[75266]:   <devices>
Nov 28 00:44:43 user nova-compute[75266]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 00:44:43 user nova-compute[75266]:     <disk type='file' device='disk'>
Nov 28 00:44:43 user nova-compute[75266]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 00:44:43 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk' index='2'/>
Nov 28 00:44:43 user nova-compute[75266]:       <backingStore type='file' index='3'>
Nov 28 00:44:43 user nova-compute[75266]:         <format type='raw'/>
Nov 28 00:44:43 user nova-compute[75266]:         <source file='/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822'/>
Nov 28 00:44:43 user nova-compute[75266]:         <backingStore/>
Nov 28 00:44:43 user nova-compute[75266]:       </backingStore>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='vda' bus='virtio'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='virtio-disk0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </disk>
Nov 28 00:44:43 user nova-compute[75266]:     <disk type='file' device='cdrom'>
Nov 28 00:44:43 user nova-compute[75266]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 00:44:43 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config' index='1'/>
Nov 28 00:44:43 user nova-compute[75266]:       <backingStore/>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='hda' bus='ide'/>
Nov 28 00:44:43 user nova-compute[75266]:       <readonly/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='ide0-0-0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </disk>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='usb' index='0' model='none'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='usb'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='pci.0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='ide' index='0'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='ide'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <interface type='ethernet'>
Nov 28 00:44:43 user nova-compute[75266]:       <mac address='fa:16:3e:bb:af:f2'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='tap734679ea-80'/>
Nov 28 00:44:43 user nova-compute[75266]:       <model type='virtio'/>
Nov 28 00:44:43 user nova-compute[75266]:       <mtu size='1442'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='net0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </interface>
Nov 28 00:44:43 user nova-compute[75266]:     <serial type='pty'>
Nov 28 00:44:43 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:43 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target type='isa-serial' port='0'>
Nov 28 00:44:43 user nova-compute[75266]:         <model name='isa-serial'/>
Nov 28 00:44:43 user nova-compute[75266]:       </target>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </serial>
Nov 28 00:44:43 user nova-compute[75266]:     <console type='pty' tty='/dev/pts/6'>
Nov 28 00:44:43 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:43 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target type='serial' port='0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </console>
Nov 28 00:44:43 user nova-compute[75266]:     <input type='mouse' bus='ps2'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='input0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </input>
Nov 28 00:44:43 user nova-compute[75266]:     <input type='keyboard' bus='ps2'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='input1'/>
Nov 28 00:44:43 user nova-compute[75266]:     </input>
Nov 28 00:44:43 user nova-compute[75266]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 28 00:44:43 user nova-compute[75266]:       <listen type='address' address='0.0.0.0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </graphics>
Nov 28 00:44:43 user nova-compute[75266]:     <audio id='1' type='none'/>
Nov 28 00:44:43 user nova-compute[75266]:     <video>
Nov 28 00:44:43 user nova-compute[75266]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='video0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </video>
Nov 28 00:44:43 user nova-compute[75266]:     <memballoon model='virtio'>
Nov 28 00:44:43 user nova-compute[75266]:       <stats period='10'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='balloon0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </memballoon>
Nov 28 00:44:43 user nova-compute[75266]:     <rng model='virtio'>
Nov 28 00:44:43 user nova-compute[75266]:       <backend model='random'>/dev/urandom</backend>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='rng0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </rng>
Nov 28 00:44:43 user nova-compute[75266]:   </devices>
Nov 28 00:44:43 user nova-compute[75266]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 00:44:43 user nova-compute[75266]:     <label>libvirt-86575409-89de-4408-a573-d069767ebb15</label>
Nov 28 00:44:43 user nova-compute[75266]:     <imagelabel>libvirt-86575409-89de-4408-a573-d069767ebb15</imagelabel>
Nov 28 00:44:43 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:43 user nova-compute[75266]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 00:44:43 user nova-compute[75266]:     <label>+64055:+108</label>
Nov 28 00:44:43 user nova-compute[75266]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 00:44:43 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:43 user nova-compute[75266]: </domain>
Nov 28 00:44:43 user nova-compute[75266]:  {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface> {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:27:ce"/><model type="virtio"/><mtu size="1442"/><target dev="tapcb19ffde-74"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 28 00:44:43 user nova-compute[75266]:   <name>instance-00000008</name>
Nov 28 00:44:43 user nova-compute[75266]:   <uuid>86575409-89de-4408-a573-d069767ebb15</uuid>
Nov 28 00:44:43 user nova-compute[75266]:   <metadata>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:43 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:44:42</nova:creationTime>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:43 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:43 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:43 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:43 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:43 user nova-compute[75266]:   </metadata>
Nov 28 00:44:43 user nova-compute[75266]:   <memory unit='KiB'>524288</memory>
Nov 28 00:44:43 user nova-compute[75266]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 00:44:43 user nova-compute[75266]:   <vcpu placement='static'>1</vcpu>
Nov 28 00:44:43 user nova-compute[75266]:   <resource>
Nov 28 00:44:43 user nova-compute[75266]:     <partition>/machine</partition>
Nov 28 00:44:43 user nova-compute[75266]:   </resource>
Nov 28 00:44:43 user nova-compute[75266]:   <sysinfo type='smbios'>
Nov 28 00:44:43 user nova-compute[75266]:     <system>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='version'>0.0.0</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='serial'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='uuid'>86575409-89de-4408-a573-d069767ebb15</entry>
Nov 28 00:44:43 user nova-compute[75266]:       <entry name='family'>Virtual Machine</entry>
Nov 28 00:44:43 user nova-compute[75266]:     </system>
Nov 28 00:44:43 user nova-compute[75266]:   </sysinfo>
Nov 28 00:44:43 user nova-compute[75266]:   <os>
Nov 28 00:44:43 user nova-compute[75266]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 00:44:43 user nova-compute[75266]:     <boot dev='hd'/>
Nov 28 00:44:43 user nova-compute[75266]:     <smbios mode='sysinfo'/>
Nov 28 00:44:43 user nova-compute[75266]:   </os>
Nov 28 00:44:43 user nova-compute[75266]:   <features>
Nov 28 00:44:43 user nova-compute[75266]:     <acpi/>
Nov 28 00:44:43 user nova-compute[75266]:     <apic/>
Nov 28 00:44:43 user nova-compute[75266]:     <vmcoreinfo state='on'/>
Nov 28 00:44:43 user nova-compute[75266]:   </features>
Nov 28 00:44:43 user nova-compute[75266]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 00:44:43 user nova-compute[75266]:     <model fallback='forbid'>Nehalem</model>
Nov 28 00:44:43 user nova-compute[75266]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='vme'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='x2apic'/>
Nov 28 00:44:43 user nova-compute[75266]:     <feature policy='require' name='hypervisor'/>
Nov 28 00:44:43 user nova-compute[75266]:   </cpu>
Nov 28 00:44:43 user nova-compute[75266]:   <clock offset='utc'>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 00:44:43 user nova-compute[75266]:     <timer name='hpet' present='no'/>
Nov 28 00:44:43 user nova-compute[75266]:   </clock>
Nov 28 00:44:43 user nova-compute[75266]:   <on_poweroff>destroy</on_poweroff>
Nov 28 00:44:43 user nova-compute[75266]:   <on_reboot>restart</on_reboot>
Nov 28 00:44:43 user nova-compute[75266]:   <on_crash>destroy</on_crash>
Nov 28 00:44:43 user nova-compute[75266]:   <devices>
Nov 28 00:44:43 user nova-compute[75266]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 00:44:43 user nova-compute[75266]:     <disk type='file' device='disk'>
Nov 28 00:44:43 user nova-compute[75266]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 00:44:43 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk' index='2'/>
Nov 28 00:44:43 user nova-compute[75266]:       <backingStore type='file' index='3'>
Nov 28 00:44:43 user nova-compute[75266]:         <format type='raw'/>
Nov 28 00:44:43 user nova-compute[75266]:         <source file='/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822'/>
Nov 28 00:44:43 user nova-compute[75266]:         <backingStore/>
Nov 28 00:44:43 user nova-compute[75266]:       </backingStore>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='vda' bus='virtio'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='virtio-disk0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </disk>
Nov 28 00:44:43 user nova-compute[75266]:     <disk type='file' device='cdrom'>
Nov 28 00:44:43 user nova-compute[75266]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 00:44:43 user nova-compute[75266]:       <source file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/disk.config' index='1'/>
Nov 28 00:44:43 user nova-compute[75266]:       <backingStore/>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='hda' bus='ide'/>
Nov 28 00:44:43 user nova-compute[75266]:       <readonly/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='ide0-0-0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </disk>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='usb' index='0' model='none'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='usb'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='pci.0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <controller type='ide' index='0'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='ide'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 00:44:43 user nova-compute[75266]:     </controller>
Nov 28 00:44:43 user nova-compute[75266]:     <interface type='ethernet'>
Nov 28 00:44:43 user nova-compute[75266]:       <mac address='fa:16:3e:bb:af:f2'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target dev='tap734679ea-80'/>
Nov 28 00:44:43 user nova-compute[75266]:       <model type='virtio'/>
Nov 28 00:44:43 user nova-compute[75266]:       <mtu size='1442'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='net0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </interface>
Nov 28 00:44:43 user nova-compute[75266]:     <serial type='pty'>
Nov 28 00:44:43 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:43 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target type='isa-serial' port='0'>
Nov 28 00:44:43 user nova-compute[75266]:         <model name='isa-serial'/>
Nov 28 00:44:43 user nova-compute[75266]:       </target>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </serial>
Nov 28 00:44:43 user nova-compute[75266]:     <console type='pty' tty='/dev/pts/6'>
Nov 28 00:44:43 user nova-compute[75266]:       <source path='/dev/pts/6'/>
Nov 28 00:44:43 user nova-compute[75266]:       <log file='/opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15/console.log' append='off'/>
Nov 28 00:44:43 user nova-compute[75266]:       <target type='serial' port='0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='serial0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </console>
Nov 28 00:44:43 user nova-compute[75266]:     <input type='mouse' bus='ps2'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='input0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </input>
Nov 28 00:44:43 user nova-compute[75266]:     <input type='keyboard' bus='ps2'>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='input1'/>
Nov 28 00:44:43 user nova-compute[75266]:     </input>
Nov 28 00:44:43 user nova-compute[75266]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 28 00:44:43 user nova-compute[75266]:       <listen type='address' address='0.0.0.0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </graphics>
Nov 28 00:44:43 user nova-compute[75266]:     <audio id='1' type='none'/>
Nov 28 00:44:43 user nova-compute[75266]:     <video>
Nov 28 00:44:43 user nova-compute[75266]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='video0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </video>
Nov 28 00:44:43 user nova-compute[75266]:     <memballoon model='virtio'>
Nov 28 00:44:43 user nova-compute[75266]:       <stats period='10'/>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='balloon0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </memballoon>
Nov 28 00:44:43 user nova-compute[75266]:     <rng model='virtio'>
Nov 28 00:44:43 user nova-compute[75266]:       <backend model='random'>/dev/urandom</backend>
Nov 28 00:44:43 user nova-compute[75266]:       <alias name='rng0'/>
Nov 28 00:44:43 user nova-compute[75266]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 00:44:43 user nova-compute[75266]:     </rng>
Nov 28 00:44:43 user nova-compute[75266]:   </devices>
Nov 28 00:44:43 user nova-compute[75266]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 00:44:43 user nova-compute[75266]:     <label>libvirt-86575409-89de-4408-a573-d069767ebb15</label>
Nov 28 00:44:43 user nova-compute[75266]:     <imagelabel>libvirt-86575409-89de-4408-a573-d069767ebb15</imagelabel>
Nov 28 00:44:43 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:43 user nova-compute[75266]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 00:44:43 user nova-compute[75266]:     <label>+64055:+108</label>
Nov 28 00:44:43 user nova-compute[75266]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 00:44:43 user nova-compute[75266]:   </seclabel>
Nov 28 00:44:43 user nova-compute[75266]: </domain>
Nov 28 00:44:43 user nova-compute[75266]:  {{(pid=75266) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 00:44:43 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Detaching interface fa:16:3e:dd:27:ce failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapcb19ffde-74' not found.
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Converting VIF {"id": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "address": "fa:16:3e:dd:27:ce", "network": {"id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1917825385", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb19ffde-74", "ovs_interfaceid": "cb19ffde-74b9-41c3-9577-eb9064e539a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG os_vif [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb19ffde-74, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:44:43 user nova-compute[75266]: INFO os_vif [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:27:ce,bridge_name='br-int',has_traffic_filtering=True,id=cb19ffde-74b9-41c3-9577-eb9064e539a6,network=Network(5b54be82-c220-4ef0-a359-dd372e82dd41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb19ffde-74')
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:43 user nova-compute[75266]:   <nova:package version="0.0.0"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:name>tempest-device-tagging-server-848238653</nova:name>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:creationTime>2023-11-28 00:44:43</nova:creationTime>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:flavor name="m1.tiny">
Nov 28 00:44:43 user nova-compute[75266]:     <nova:memory>512</nova:memory>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:disk>1</nova:disk>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:swap>0</nova:swap>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:flavor>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:user uuid="4fa42e3664c64c9696a0bbd62853c291">tempest-TaggedAttachmentsTest-787925865-project-member</nova:user>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:project uuid="9b41d15ebfac4bb8aa32e310b2b2adee">tempest-TaggedAttachmentsTest-787925865</nova:project>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:owner>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:43 user nova-compute[75266]:   <nova:ports>
Nov 28 00:44:43 user nova-compute[75266]:     <nova:port uuid="734679ea-803f-454c-ad23-ed3bbd4951e5">
Nov 28 00:44:43 user nova-compute[75266]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:44:43 user nova-compute[75266]:     </nova:port>
Nov 28 00:44:43 user nova-compute[75266]:   </nova:ports>
Nov 28 00:44:43 user nova-compute[75266]: </nova:instance>
Nov 28 00:44:43 user nova-compute[75266]:  {{(pid=75266) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-deleted-b4b1bb66-214e-4774-96ca-91634121b5d5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-deleted-6b322b03-7a4e-4a72-8a3d-3cc3a485f801 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-deleted-f6ea4af3-eb88-4c03-a3bf-c852a8464e52 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Received event network-vif-deleted-93942af8-6733-4aa8-ab7a-6306b5196f30 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:43 user nova-compute[75266]: INFO nova.network.neutron [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Port cb19ffde-74b9-41c3-9577-eb9064e539a6 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 28 00:44:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [{"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Releasing lock "refresh_cache-86575409-89de-4408-a573-d069767ebb15" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "interface-86575409-89de-4408-a573-d069767ebb15-cb19ffde-74b9-41c3-9577-eb9064e539a6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.834s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:44 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:44:44 user nova-compute[75266]: INFO nova.compute.claims [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Claim successful on node user
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:44:45 user nova-compute[75266]: INFO nova.compute.manager [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Took 2.36 seconds to detach 3 volumes for instance.
Nov 28 00:44:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.policy [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:44:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Creating image(s)
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "/opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "/opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:45 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Deleted allocations for instance 51a4dd5e-3313-4c04-a699-9184465e9895
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk 1073741824" returned: 0 in 0.057s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Successfully created port: 09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "51a4dd5e-3313-4c04-a699-9184465e9895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.528s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:44:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Cannot resize image /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Ensure instance console log exists: /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Successfully updated port: 09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquired lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received event network-changed-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Refreshing instance network info cache due to event network-changed-09f3cea2-142d-4c24-8c21-27880492615b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Acquiring lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Updating instance_info_cache with network_info: [{"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Releasing lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Instance network_info: |[{"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Acquired lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Refreshing network info cache for port 09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Start _get_guest_xml network_info=[{"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:44:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:44:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-690874260',display_name='tempest-VolumesAdminNegativeTest-server-690874260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-690874260',id=14,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-h8t0alp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:44:45Z,user_data=None,user_id='6657488fa71b469c954276af7717308e',uuid=d9e00566-f7d4-4022-9377-94fcb8f54fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'pci_devices' on Instance uuid d9e00566-f7d4-4022-9377-94fcb8f54fd3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:44:47 user nova-compute[75266]:   <uuid>d9e00566-f7d4-4022-9377-94fcb8f54fd3</uuid>
Nov 28 00:44:47 user nova-compute[75266]:   <name>instance-0000000e</name>
Nov 28 00:44:47 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:44:47 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:44:47 user nova-compute[75266]:   <metadata>
Nov 28 00:44:47 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:44:47 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:name>tempest-VolumesAdminNegativeTest-server-690874260</nova:name>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:44:47</nova:creationTime>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:44:47 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:44:47 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:owner>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:user uuid="6657488fa71b469c954276af7717308e">tempest-VolumesAdminNegativeTest-119723273-project-member</nova:user>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:project uuid="ea1afcbb4b3643c5ae366c8e39f3d8ed">tempest-VolumesAdminNegativeTest-119723273</nova:project>
Nov 28 00:44:47 user nova-compute[75266]:       </nova:owner>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:44:47 user nova-compute[75266]:       <nova:ports>
Nov 28 00:44:47 user nova-compute[75266]:         <nova:port uuid="09f3cea2-142d-4c24-8c21-27880492615b">
Nov 28 00:44:47 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 00:44:47 user nova-compute[75266]:         </nova:port>
Nov 28 00:44:47 user nova-compute[75266]:       </nova:ports>
Nov 28 00:44:47 user nova-compute[75266]:     </nova:instance>
Nov 28 00:44:47 user nova-compute[75266]:   </metadata>
Nov 28 00:44:47 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:44:47 user nova-compute[75266]:     <system>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="serial">d9e00566-f7d4-4022-9377-94fcb8f54fd3</entry>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="uuid">d9e00566-f7d4-4022-9377-94fcb8f54fd3</entry>
Nov 28 00:44:47 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:44:47 user nova-compute[75266]:     </system>
Nov 28 00:44:47 user nova-compute[75266]:   </sysinfo>
Nov 28 00:44:47 user nova-compute[75266]:   <os>
Nov 28 00:44:47 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:44:47 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:44:47 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:44:47 user nova-compute[75266]:   </os>
Nov 28 00:44:47 user nova-compute[75266]:   <features>
Nov 28 00:44:47 user nova-compute[75266]:     <acpi/>
Nov 28 00:44:47 user nova-compute[75266]:     <apic/>
Nov 28 00:44:47 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:44:47 user nova-compute[75266]:   </features>
Nov 28 00:44:47 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:44:47 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:44:47 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:44:47 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:44:47 user nova-compute[75266]:   </clock>
Nov 28 00:44:47 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:44:47 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:44:47 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:44:47 user nova-compute[75266]:   </cpu>
Nov 28 00:44:47 user nova-compute[75266]:   <devices>
Nov 28 00:44:47 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:44:47 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:44:47 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk"/>
Nov 28 00:44:47 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:44:47 user nova-compute[75266]:     </disk>
Nov 28 00:44:47 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:44:47 user nova-compute[75266]:       <mac address="fa:16:3e:c2:19:f0"/>
Nov 28 00:44:47 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:44:47 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:44:47 user nova-compute[75266]:       <target dev="tap09f3cea2-14"/>
Nov 28 00:44:47 user nova-compute[75266]:     </interface>
Nov 28 00:44:47 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:44:47 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/console.log" append="off"/>
Nov 28 00:44:47 user nova-compute[75266]:     </serial>
Nov 28 00:44:47 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:44:47 user nova-compute[75266]:     <video>
Nov 28 00:44:47 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:44:47 user nova-compute[75266]:     </video>
Nov 28 00:44:47 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:44:47 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:44:47 user nova-compute[75266]:     </rng>
Nov 28 00:44:47 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:44:47 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:44:47 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:44:47 user nova-compute[75266]:     </memballoon>
Nov 28 00:44:47 user nova-compute[75266]:   </devices>
Nov 28 00:44:47 user nova-compute[75266]: </domain>
Nov 28 00:44:47 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-690874260',display_name='tempest-VolumesAdminNegativeTest-server-690874260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-690874260',id=14,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-h8t0alp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:44:45Z,user_data=None,user_id='6657488fa71b469c954276af7717308e',uuid=d9e00566-f7d4-4022-9377-94fcb8f54fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG os_vif [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dacd64a6-3d20-5016-a64d-6a6a2b20b64c', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09f3cea2-14, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09f3cea2-14, col_values=(('qos', UUID('f3f52968-8b97-4791-9915-fad334f4a9eb')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09f3cea2-14, col_values=(('external_ids', {'iface-id': '09f3cea2-142d-4c24-8c21-27880492615b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:19:f0', 'vm-uuid': 'd9e00566-f7d4-4022-9377-94fcb8f54fd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:47 user nova-compute[75266]: INFO os_vif [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14')
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] No VIF found with MAC fa:16:3e:c2:19:f0, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Updated VIF entry in instance network info cache for port 09f3cea2-142d-4c24-8c21-27880492615b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Updating instance_info_cache with network_info: [{"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Releasing lock "refresh_cache-d9e00566-f7d4-4022-9377-94fcb8f54fd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received event network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Acquiring lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] No waiting events found dispatching network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:49 user nova-compute[75266]: WARNING nova.compute.manager [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received unexpected event network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b for instance with vm_state building and task_state spawning.
Nov 28 00:44:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:50 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46fb5677-018f-4e32-b945-166600ec6a24 is timed out.
Nov 28 00:44:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Successfully detached device vdb from instance 46fb5677-018f-4e32-b945-166600ec6a24 from the live domain config.
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQGChzrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '03ee4663-c44a-45b0-8721-f33b791fcbbf'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:44:50 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b717a4-adcb-4e48-a8a6-ac6688d28a64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:44:50 user nova-compute[75266]: No targets found.
Nov 28 00:44:50 user nova-compute[75266]: iSNS:
Nov 28 00:44:50 user nova-compute[75266]: No targets found.
Nov 28 00:44:50 user nova-compute[75266]: STATIC:
Nov 28 00:44:50 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:44:50 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:50 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:50 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf
Nov 28 00:44:50 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:44:50 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:44:50 user nova-compute[75266]: FIRMWARE:
Nov 28 00:44:50 user nova-compute[75266]: No targets found.
Nov 28 00:44:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:44:50 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:44:50 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[43813042-ed3e-460c-b0fc-b5a42877781b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad4cd2-d99e-4b28-b4c5-84625becf14d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:50 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf (non-flash)
Nov 28 00:44:50 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:44:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c3bee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5d3cbe-9ebe-4a25-b3f7-24f90534f453]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba674f5c-9673-4611-a0aa-f9d52aa96cf3]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccda2f7-80a9-4185-879f-b8f60b6cd39a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02a3cc-d5e1-4c7e-8f0e-0daa9787b2e0]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fbecb5-da51-4aa0-8b78-53b13641d1fa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[776337d4-a9b0-49a2-bd39-3ee33ff4fe86]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260]
Nov 28 00:44:50 user nova-compute[75266]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf, portal: 172.16.0.220,3260] successful.
Nov 28 00:44:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03ee4663-c44a-45b0-8721-f33b791fcbbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e7d83-acae-4b45-a6e0-f1ff0445e565]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] <== disconnect_volume: return (272ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:44:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Instance spawned successfully.
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:44:50 user nova-compute[75266]: INFO nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 28 00:44:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received event network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Acquiring lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] No waiting events found dispatching network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:51 user nova-compute[75266]: WARNING nova.compute.manager [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received unexpected event network-vif-plugged-09f3cea2-142d-4c24-8c21-27880492615b for instance with vm_state building and task_state spawning.
Nov 28 00:44:51 user nova-compute[75266]: INFO nova.compute.manager [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Took 6.45 seconds to build instance.
Nov 28 00:44:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.537s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'flavor' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-changed-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Refreshing instance network info cache due to event network-changed-8482d7a1-9b99-461b-aff7-9748c14d2529. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:44:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Acquiring lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:44:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Acquired lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:44:56 user nova-compute[75266]: DEBUG nova.network.neutron [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Refreshing network info cache for port 8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:44:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updated VIF entry in instance network info cache for port 8482d7a1-9b99-461b-aff7-9748c14d2529. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:44:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updating instance_info_cache with network_info: [{"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:44:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Releasing lock "refresh_cache-2619f610-3a3c-4b48-9448-c30d75414e56" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:58 user nova-compute[75266]: INFO nova.compute.manager [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Terminating instance
Nov 28 00:44:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-unplugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] No waiting events found dispatching network-vif-unplugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-unplugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:44:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Instance destroyed successfully.
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lazy-loading 'resources' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2042329240',display_name='tempest-VolumesAssistedSnapshotsTest-server-2042329240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2042329240',id=10,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvTiY4dxQAb9LsYRO0lskk9ck/WkedyunqgTAhqwxwkQxob6pmFUtvNK0PLIropmLdelwefawXtUbFkAj07J8tGnQxdvzeSVHovmSM6IobjeCc2WsqnQKXobXN3gL+AtQ==',key_name='tempest-keypair-120630317',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47ed4d4553b4460ca8688714e6d7c335',ramdisk_id='',reservation_id='r-ok41bpzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1497464835',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1497464835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='764878c5fd98438193043f4a5e812442',uuid=fdea5f7d-ce77-4c66-afac-ddc24baeabd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converting VIF {"id": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "address": "fa:16:3e:f8:1a:64", "network": {"id": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-675500781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47ed4d4553b4460ca8688714e6d7c335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd82c939-7f", "ovs_interfaceid": "cd82c939-7f4c-4114-97c2-9a4f166d9e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG os_vif [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd82c939-7f, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bcfb15b-74fa-489c-a44e-a2d0b6de22c3) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:44:59 user nova-compute[75266]: INFO os_vif [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:64,bridge_name='br-int',has_traffic_filtering=True,id=cd82c939-7f4c-4114-97c2-9a4f166d9e23,network=Network(54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd82c939-7f')
Nov 28 00:44:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Deleting instance files /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9_del
Nov 28 00:44:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Deletion of /opt/stack/data/nova/instances/fdea5f7d-ce77-4c66-afac-ddc24baeabd9_del complete
Nov 28 00:44:59 user nova-compute[75266]: INFO nova.compute.manager [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 00:44:59 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:44:59 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'flavor' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:00 user nova-compute[75266]: INFO nova.compute.manager [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Attaching volume 690a2933-f2cc-4d04-b41a-41189277b740 to /dev/vdb
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c745032-e938-4419-a306-e4e685625acd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00649a-a224-4834-b48a-50bd2a4ba9af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9311f-96d0-4187-9ed5-de80b797493d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edd5626-3a25-41ce-b02e-5b2e6b24a6c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:45:00 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b0825-7e50-46f9-8539-2212d3594fcb]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updating existing volume attachment record: f8f5d695-aa79-4a01-8abb-50e6fa592121 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:00 user nova-compute[75266]: INFO nova.compute.manager [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Terminating instance
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Took 1.25 seconds to deallocate network for instance.
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-deleted-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.compute.manager [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Neutron deleted interface cd82c939-7f4c-4114-97c2-9a4f166d9e23; detaching it from the instance and deleting it from the info cache
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Detach interface failed, port_id=cd82c939-7f4c-4114-97c2-9a4f166d9e23, reason: Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Acquiring lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] No waiting events found dispatching network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:01 user nova-compute[75266]: WARNING nova.compute.manager [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Received unexpected event network-vif-plugged-cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance with vm_state deleted and task_state None.
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-unplugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] No waiting events found dispatching network-vif-unplugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-unplugged-67eed799-ef90-48cc-a9c5-5c6243147147 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Instance destroyed successfully.
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lazy-loading 'resources' on Instance uuid cd2dca4b-65fc-4db5-a4f0-60d592d1a4db {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-539144485',display_name='tempest-VolumesNegativeTest-instance-539144485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-539144485',id=13,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f78eaf469545e2ba9232811de8e3a0',ramdisk_id='',reservation_id='r-8zycg9mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-493175275',owner_user_name='tempest-VolumesNegativeTest-493175275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:17Z,user_data=None,user_id='f853e07c209544cf88d39ad0a2f3a694',uuid=cd2dca4b-65fc-4db5-a4f0-60d592d1a4db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converting VIF {"id": "67eed799-ef90-48cc-a9c5-5c6243147147", "address": "fa:16:3e:48:64:8b", "network": {"id": "d01212a4-2f00-4cb8-a26d-0dd6db82e7c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ee7a3bfd33a24e66a77d46cd10166206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67eed799-ef", "ovs_interfaceid": "67eed799-ef90-48cc-a9c5-5c6243147147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG os_vif [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67eed799-ef, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee0b22fc-420d-4ca0-96af-3ed57a9b5b37) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:01 user nova-compute[75266]: INFO os_vif [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:64:8b,bridge_name='br-int',has_traffic_filtering=True,id=67eed799-ef90-48cc-a9c5-5c6243147147,network=Network(d01212a4-2f00-4cb8-a26d-0dd6db82e7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67eed799-ef')
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Deleting instance files /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db_del
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Deletion of /opt/stack/data/nova/instances/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db_del complete
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Deleted allocations for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9
Nov 28 00:45:01 user nova-compute[75266]: INFO nova.compute.manager [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:45:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "fdea5f7d-ce77-4c66-afac-ddc24baeabd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.900s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:02 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:02 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Took 0.37 seconds to deallocate network for instance.
Nov 28 00:45:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:02 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:02 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:02 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Deleted allocations for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db
Nov 28 00:45:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-deleted-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Acquiring lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Lock "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] No waiting events found dispatching network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:03 user nova-compute[75266]: WARNING nova.compute.manager [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Received unexpected event network-vif-plugged-67eed799-ef90-48cc-a9c5-5c6243147147 for instance with vm_state deleted and task_state None.
Nov 28 00:45:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaGRsinO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:07 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8accd-6d89-48e8-98d2-cb57d22eccd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:45:07 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db60feed-1e19-4a89-b725-5023c452dbe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740] added
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[afadec7c-c02e-4ba4-8371-feaef41b2123]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a184f8-8a52-4234-892d-c93dad913f7e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaGRsinO {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaGRsinO" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf70ac0-9468-4c36-9b8d-804164e14c37]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaGRsinO'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1f79c1-df2c-486f-b9ca-6eeb2c70d574]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c64eea-2564-42dd-a7eb-7299aa99bd30]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[926cd3af-cfc6-4b33-82fe-556501e45428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260]
Nov 28 00:45:07 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260] successful.
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d134b826-7818-422f-9f0b-4fc0a8fa2e31]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9881517-7faf-4299-ad74-272214604f7e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc13322-fdc6-4e5e-a26a-e8c2c13984a2]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:45:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaGRsinO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:45:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23437303262353465', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437303262353465', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:45:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'flavor' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:45:08 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:45:08 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 00:45:08 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:45:08 user nova-compute[75266]:   <serial>690a2933-f2cc-4d04-b41a-41189277b740</serial>
Nov 28 00:45:08 user nova-compute[75266]: </disk>
Nov 28 00:45:08 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:45:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:45:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:45:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] No VIF found with MAC fa:16:3e:a4:e6:b7, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:45:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.863s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:11 user nova-compute[75266]: INFO nova.compute.manager [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Detaching volume 690a2933-f2cc-4d04-b41a-41189277b740
Nov 28 00:45:11 user nova-compute[75266]: INFO nova.virt.block_device [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Attempting to driver detach volume 690a2933-f2cc-4d04-b41a-41189277b740 from mountpoint /dev/vdb
Nov 28 00:45:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Attempting to detach device vdb from instance 2619f610-3a3c-4b48-9448-c30d75414e56 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:45:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:45:11 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:45:11 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 00:45:11 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:45:11 user nova-compute[75266]:   <serial>690a2933-f2cc-4d04-b41a-41189277b740</serial>
Nov 28 00:45:11 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:45:11 user nova-compute[75266]: </disk>
Nov 28 00:45:11 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:45:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Successfully detached device vdb from instance 2619f610-3a3c-4b48-9448-c30d75414e56 from the persistent domain config.
Nov 28 00:45:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2619f610-3a3c-4b48-9448-c30d75414e56 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:45:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:45:11 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:45:11 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 00:45:11 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:45:11 user nova-compute[75266]:   <serial>690a2933-f2cc-4d04-b41a-41189277b740</serial>
Nov 28 00:45:11 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:45:11 user nova-compute[75266]: </disk>
Nov 28 00:45:11 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:12 user nova-compute[75266]: INFO nova.compute.manager [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Terminating instance
Nov 28 00:45:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:45:12 user nova-compute[75266]: INFO nova.compute.claims [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Claim successful on node user
Nov 28 00:45:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-unplugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-unplugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-unplugged-734679ea-803f-454c-ad23-ed3bbd4951e5 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 86575409-89de-4408-a573-d069767ebb15] Instance destroyed successfully.
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'resources' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848238653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848238653',id=8,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg==',key_name='tempest-keypair-1061836304',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b41d15ebfac4bb8aa32e310b2b2adee',ramdisk_id='',reservation_id='r-zm09kl0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-787925865',owner_user_name='tempest-TaggedAttachmentsTest-787925865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa42e3664c64c9696a0bbd62853c291',uuid=86575409-89de-4408-a573-d069767ebb15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converting VIF {"id": "734679ea-803f-454c-ad23-ed3bbd4951e5", "address": "fa:16:3e:bb:af:f2", "network": {"id": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-449303665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b41d15ebfac4bb8aa32e310b2b2adee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734679ea-80", "ovs_interfaceid": "734679ea-803f-454c-ad23-ed3bbd4951e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG os_vif [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap734679ea-80, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ba40d3a-31e0-4375-87e2-dcc9e3f01e7e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:13 user nova-compute[75266]: INFO os_vif [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:af:f2,bridge_name='br-int',has_traffic_filtering=True,id=734679ea-803f-454c-ad23-ed3bbd4951e5,network=Network(7139c69b-63ec-4a2d-8d3d-d7ed611dbe56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734679ea-80')
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Deleting instance files /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15_del
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Deletion of /opt/stack/data/nova/instances/86575409-89de-4408-a573-d069767ebb15_del complete
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.compute.manager [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 86575409-89de-4408-a573-d069767ebb15] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 86575409-89de-4408-a573-d069767ebb15] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.policy [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:45:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Creating image(s)
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk 1073741824" returned: 0 in 0.069s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:14 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 86575409-89de-4408-a573-d069767ebb15] Took 1.02 seconds to deallocate network for instance.
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-deleted-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:14 user nova-compute[75266]: INFO nova.compute.manager [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Neutron deleted interface 734679ea-803f-454c-ad23-ed3bbd4951e5; detaching it from the instance and deleting it from the info cache
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Cannot resize image /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Ensure instance console log exists: /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Detach interface failed, port_id=734679ea-803f-454c-ad23-ed3bbd4951e5, reason: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Successfully created port: 85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Acquiring lock "86575409-89de-4408-a573-d069767ebb15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Lock "86575409-89de-4408-a573-d069767ebb15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] No waiting events found dispatching network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:15 user nova-compute[75266]: WARNING nova.compute.manager [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] [instance: 86575409-89de-4408-a573-d069767ebb15] Received unexpected event network-vif-plugged-734679ea-803f-454c-ad23-ed3bbd4951e5 for instance with vm_state deleted and task_state None.
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:15 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Deleted allocations for instance 86575409-89de-4408-a573-d069767ebb15
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "86575409-89de-4408-a573-d069767ebb15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.561s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Successfully updated port: 85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating instance_info_cache with network_info: [{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance network_info: |[{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:45:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start _get_guest_xml network_info=[{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:45:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-tempest.common.compute-instance-1551649898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'pci_devices' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:45:16 user nova-compute[75266]:   <uuid>ccbf5fa2-6207-49fd-9cca-127fb0358d08</uuid>
Nov 28 00:45:16 user nova-compute[75266]:   <name>instance-0000000f</name>
Nov 28 00:45:16 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:45:16 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:45:16 user nova-compute[75266]:   <metadata>
Nov 28 00:45:16 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:45:16 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:name>tempest-tempest.common.compute-instance-1551649898</nova:name>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:45:16</nova:creationTime>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:45:16 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:45:16 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:owner>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:user uuid="f63a0e9261934c8b8e673f069c3376bd">tempest-ServerActionsTestOtherA-277302336-project-member</nova:user>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:project uuid="22c31829ff0846fc8584d492bea6cdc4">tempest-ServerActionsTestOtherA-277302336</nova:project>
Nov 28 00:45:16 user nova-compute[75266]:       </nova:owner>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:45:16 user nova-compute[75266]:       <nova:ports>
Nov 28 00:45:16 user nova-compute[75266]:         <nova:port uuid="85cfd155-656c-4678-9381-9603640b1bd4">
Nov 28 00:45:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:45:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:45:16 user nova-compute[75266]:       </nova:ports>
Nov 28 00:45:16 user nova-compute[75266]:     </nova:instance>
Nov 28 00:45:16 user nova-compute[75266]:   </metadata>
Nov 28 00:45:16 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:45:16 user nova-compute[75266]:     <system>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="serial">ccbf5fa2-6207-49fd-9cca-127fb0358d08</entry>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="uuid">ccbf5fa2-6207-49fd-9cca-127fb0358d08</entry>
Nov 28 00:45:16 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:45:16 user nova-compute[75266]:     </system>
Nov 28 00:45:16 user nova-compute[75266]:   </sysinfo>
Nov 28 00:45:16 user nova-compute[75266]:   <os>
Nov 28 00:45:16 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:45:16 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:45:16 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:45:16 user nova-compute[75266]:   </os>
Nov 28 00:45:16 user nova-compute[75266]:   <features>
Nov 28 00:45:16 user nova-compute[75266]:     <acpi/>
Nov 28 00:45:16 user nova-compute[75266]:     <apic/>
Nov 28 00:45:16 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:45:16 user nova-compute[75266]:   </features>
Nov 28 00:45:16 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:45:16 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:45:16 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:45:16 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:45:16 user nova-compute[75266]:   </clock>
Nov 28 00:45:16 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:45:16 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:45:16 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:45:16 user nova-compute[75266]:   </cpu>
Nov 28 00:45:16 user nova-compute[75266]:   <devices>
Nov 28 00:45:16 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:45:16 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:45:16 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk"/>
Nov 28 00:45:16 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:45:16 user nova-compute[75266]:     </disk>
Nov 28 00:45:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:45:16 user nova-compute[75266]:       <mac address="fa:16:3e:60:ee:42"/>
Nov 28 00:45:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:45:16 user nova-compute[75266]:       <target dev="tap85cfd155-65"/>
Nov 28 00:45:16 user nova-compute[75266]:     </interface>
Nov 28 00:45:16 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:45:16 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/console.log" append="off"/>
Nov 28 00:45:16 user nova-compute[75266]:     </serial>
Nov 28 00:45:16 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:45:16 user nova-compute[75266]:     <video>
Nov 28 00:45:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:16 user nova-compute[75266]:     </video>
Nov 28 00:45:16 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:45:16 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:45:16 user nova-compute[75266]:     </rng>
Nov 28 00:45:16 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:45:16 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:45:16 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:45:16 user nova-compute[75266]:     </memballoon>
Nov 28 00:45:16 user nova-compute[75266]:   </devices>
Nov 28 00:45:16 user nova-compute[75266]: </domain>
Nov 28 00:45:16 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-tempest.common.compute-instance-1551649898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG os_vif [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0f07b59-ded9-5eba-897d-3725ccbd7ef5', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85cfd155-65, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85cfd155-65, col_values=(('qos', UUID('8bf7d505-4eaf-4e99-adb2-c182394bad37')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85cfd155-65, col_values=(('external_ids', {'iface-id': '85cfd155-656c-4678-9381-9603640b1bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ee:42', 'vm-uuid': 'ccbf5fa2-6207-49fd-9cca-127fb0358d08'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: INFO os_vif [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65')
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:60:ee:42, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-changed-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Refreshing instance network info cache due to event network-changed-85cfd155-656c-4678-9381-9603640b1bd4. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Acquiring lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Acquired lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Refreshing network info cache for port 85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updated VIF entry in instance network info cache for port 85cfd155-656c-4678-9381-9603640b1bd4. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating instance_info_cache with network_info: [{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Releasing lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:17 user nova-compute[75266]: WARNING nova.compute.manager [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state building and task_state spawning.
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:45:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:45:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance spawned successfully.
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:19 user nova-compute[75266]: INFO nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 28 00:45:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:20 user nova-compute[75266]: WARNING nova.compute.manager [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state building and task_state spawning.
Nov 28 00:45:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.411300659179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:20 user nova-compute[75266]: INFO nova.compute.manager [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Took 7.45 seconds to build instance.
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.578s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 46fb5677-018f-4e32-b945-166600ec6a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 2619f610-3a3c-4b48-9448-c30d75414e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:20 user nova-compute[75266]: INFO nova.compute.manager [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Terminating instance
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-unplugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] No waiting events found dispatching network-vif-unplugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-unplugged-d958f7e8-8730-4756-8515-ce61c1d1efce for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:45:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Instance destroyed successfully.
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'resources' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-255438338',display_name='tempest-TestVolumeSwap-server-255438338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-255438338',id=9,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI8v8L4f2bUuyj5OhUmhozUp13Ks3fEXRi3Oj6qTZkdAZBJ96CVn6kUw9HpfFZZCCphg/vMW3teFNC6XQPhuvhYhd7IKUXYFQ+6Z9SU6vXSbWsXURJpVx1JUUK/fwm46Q==',key_name='tempest-keypair-7931677',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfcf25cb4d7643beaf41d08d65c37c76',ramdisk_id='',reservation_id='r-274gfgv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-792541960',owner_user_name='tempest-TestVolumeSwap-792541960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4107c4de40db41478617a3e7740cdaf2',uuid=46fb5677-018f-4e32-b945-166600ec6a24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converting VIF {"id": "d958f7e8-8730-4756-8515-ce61c1d1efce", "address": "fa:16:3e:28:53:e2", "network": {"id": "a7880cfb-ac6f-473a-95b4-3f450cdae98d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1240202114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfcf25cb4d7643beaf41d08d65c37c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd958f7e8-87", "ovs_interfaceid": "d958f7e8-8730-4756-8515-ce61c1d1efce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG os_vif [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd958f7e8-87, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=502f4a7d-cf91-48e5-97ab-fd87493bc68e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:21 user nova-compute[75266]: INFO os_vif [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:53:e2,bridge_name='br-int',has_traffic_filtering=True,id=d958f7e8-8730-4756-8515-ce61c1d1efce,network=Network(a7880cfb-ac6f-473a-95b4-3f450cdae98d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd958f7e8-87')
Nov 28 00:45:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Deleting instance files /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24_del
Nov 28 00:45:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Deletion of /opt/stack/data/nova/instances/46fb5677-018f-4e32-b945-166600ec6a24_del complete
Nov 28 00:45:21 user nova-compute[75266]: INFO nova.compute.manager [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:22 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Took 0.70 seconds to deallocate network for instance.
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-deleted-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:22 user nova-compute[75266]: INFO nova.compute.manager [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Neutron deleted interface d958f7e8-8730-4756-8515-ce61c1d1efce; detaching it from the instance and deleting it from the info cache
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Detach interface failed, port_id=d958f7e8-8730-4756-8515-ce61c1d1efce, reason: Instance 46fb5677-018f-4e32-b945-166600ec6a24 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:22 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Deleted allocations for instance 46fb5677-018f-4e32-b945-166600ec6a24
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "46fb5677-018f-4e32-b945-166600ec6a24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Acquiring lock "46fb5677-018f-4e32-b945-166600ec6a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Lock "46fb5677-018f-4e32-b945-166600ec6a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] No waiting events found dispatching network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:23 user nova-compute[75266]: WARNING nova.compute.manager [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Received unexpected event network-vif-plugged-d958f7e8-8730-4756-8515-ce61c1d1efce for instance with vm_state deleted and task_state None.
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.network.neutron [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'info_cache' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:23 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:45:24 user nova-compute[75266]: INFO nova.compute.claims [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Claim successful on node user
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance destroyed successfully.
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'resources' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598b9806-e5, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54e7fc78-e963-410b-a46b-bb03640bd5a0) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:24 user nova-compute[75266]: INFO os_vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:24 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f9b75-bab2-4f88-8496-2db83ddef579]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:45:24 user nova-compute[75266]: No targets found.
Nov 28 00:45:24 user nova-compute[75266]: iSNS:
Nov 28 00:45:24 user nova-compute[75266]: No targets found.
Nov 28 00:45:24 user nova-compute[75266]: STATIC:
Nov 28 00:45:24 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:45:24 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:45:24 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:45:24 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740
Nov 28 00:45:24 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:45:24 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:45:24 user nova-compute[75266]: FIRMWARE:
Nov 28 00:45:24 user nova-compute[75266]: No targets found.
Nov 28 00:45:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:45:24 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:45:24 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb826032-dabf-4212-a6d0-1daafe5ac9a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da010d-48cb-4ee3-aa89-4acb3fd012ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:24 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:24 user nova-compute[75266]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c3bf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e40897-1973-4fc9-a1bb-b71bc31b5d90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31757f00-b137-47cb-9b3b-1250ed2e9061]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3113fa0-639e-41b5-a59c-426c57eaa0ef]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[311822f4-3959-48b3-a94f-82f228e2d1ed]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: INFO nova.virt.block_device [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Booting with blank volume at /dev/vda
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1f72c8-a80a-454e-99ba-b8ea98f8abce]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.policy [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[220323dc-fc88-45b7-bafc-5fd979e8c305]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]
Nov 28 00:45:24 user nova-compute[75266]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.
Nov 28 00:45:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf93b33-15fc-4a60-9e95-dfbbd7d5ad27]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== disconnect_volume: return (343ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start _get_guest_xml network_info=[{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6f7c5378-aadc-45e4-b3c3-d308e526b03a', 'attached_at': '', 'detached_at': '', 'volume_id': '50546c9b-1f14-449e-b7dd-a9376344f840', 'serial': '50546c9b-1f14-449e-b7dd-a9376344f840'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'ca1ac1d2-7aaa-41eb-877b-58fec0ce76d2', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:45:24 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:25 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:25 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:25 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159788b-ec4d-4f37-a557-fd0a0baf326c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:45:25 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b05a3e-3740-4d92-baa9-688d28507ae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840] added
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d3f4a-b548-4859-ba64-7782e6f03052]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece0abb-70d3-4281-a46e-575b7bf62802]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKMiafcG {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKMiafcG" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e42fbd-a24a-4a8d-b6b1-fe3275a689b9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKMiafcG'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00741f-345f-494a-93e6-a645a45b4367]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f487868-0e19-41cf-9f9f-c53b01c3d535]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[063816c8-e06e-474b-829b-87fddc5951c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]
Nov 28 00:45:25 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfeb4e-95ea-4351-b833-8ec0546b8c96]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b597459-bdab-4eec-b1f7-d7fa4c127d31]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:25 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e80b4d7-606a-4820-a46d-651a59afa361]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Successfully created port: d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Successfully updated port: d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-changed-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Refreshing instance network info cache due to event network-changed-d57d7084-7f1f-4e79-9770-0fe51e5f13fc. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23039643738396136', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039643738396136', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:45:26 user nova-compute[75266]:   <uuid>6f7c5378-aadc-45e4-b3c3-d308e526b03a</uuid>
Nov 28 00:45:26 user nova-compute[75266]:   <name>instance-00000001</name>
Nov 28 00:45:26 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:45:26 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:45:26 user nova-compute[75266]:   <metadata>
Nov 28 00:45:26 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:45:26 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeTestJSON-server-1318610697</nova:name>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:45:24</nova:creationTime>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:45:26 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:45:26 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:owner>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:user uuid="7cf2b106f48442cd84784a5880737464">tempest-AttachVolumeTestJSON-1794071981-project-member</nova:user>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:project uuid="7cf38cc0048d41bfb69a50d55f9c1963">tempest-AttachVolumeTestJSON-1794071981</nova:project>
Nov 28 00:45:26 user nova-compute[75266]:       </nova:owner>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:45:26 user nova-compute[75266]:       <nova:ports>
Nov 28 00:45:26 user nova-compute[75266]:         <nova:port uuid="598b9806-e561-4d8b-9e33-1e8ec1268b48">
Nov 28 00:45:26 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:45:26 user nova-compute[75266]:         </nova:port>
Nov 28 00:45:26 user nova-compute[75266]:       </nova:ports>
Nov 28 00:45:26 user nova-compute[75266]:     </nova:instance>
Nov 28 00:45:26 user nova-compute[75266]:   </metadata>
Nov 28 00:45:26 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:45:26 user nova-compute[75266]:     <system>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="serial">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="uuid">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:45:26 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:45:26 user nova-compute[75266]:     </system>
Nov 28 00:45:26 user nova-compute[75266]:   </sysinfo>
Nov 28 00:45:26 user nova-compute[75266]:   <os>
Nov 28 00:45:26 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:45:26 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:45:26 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:45:26 user nova-compute[75266]:   </os>
Nov 28 00:45:26 user nova-compute[75266]:   <features>
Nov 28 00:45:26 user nova-compute[75266]:     <acpi/>
Nov 28 00:45:26 user nova-compute[75266]:     <apic/>
Nov 28 00:45:26 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:45:26 user nova-compute[75266]:   </features>
Nov 28 00:45:26 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:45:26 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:45:26 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:45:26 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:45:26 user nova-compute[75266]:   </clock>
Nov 28 00:45:26 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:45:26 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:45:26 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:45:26 user nova-compute[75266]:   </cpu>
Nov 28 00:45:26 user nova-compute[75266]:   <devices>
Nov 28 00:45:26 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:45:26 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:45:26 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk"/>
Nov 28 00:45:26 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:45:26 user nova-compute[75266]:     </disk>
Nov 28 00:45:26 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:45:26 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:45:26 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 00:45:26 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:45:26 user nova-compute[75266]:       <serial>50546c9b-1f14-449e-b7dd-a9376344f840</serial>
Nov 28 00:45:26 user nova-compute[75266]:     </disk>
Nov 28 00:45:26 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:45:26 user nova-compute[75266]:       <mac address="fa:16:3e:6b:f5:56"/>
Nov 28 00:45:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:26 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:45:26 user nova-compute[75266]:       <target dev="tap598b9806-e5"/>
Nov 28 00:45:26 user nova-compute[75266]:     </interface>
Nov 28 00:45:26 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:45:26 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/console.log" append="off"/>
Nov 28 00:45:26 user nova-compute[75266]:     </serial>
Nov 28 00:45:26 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:45:26 user nova-compute[75266]:     <video>
Nov 28 00:45:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:26 user nova-compute[75266]:     </video>
Nov 28 00:45:26 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:45:26 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:45:26 user nova-compute[75266]:     </rng>
Nov 28 00:45:26 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:45:26 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:45:26 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:45:26 user nova-compute[75266]:     </memballoon>
Nov 28 00:45:26 user nova-compute[75266]:   </devices>
Nov 28 00:45:26 user nova-compute[75266]: </domain>
Nov 28 00:45:26 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance network_info: |[{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.network.neutron [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Refreshing network info cache for port d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updated VIF entry in instance network info cache for port d57d7084-7f1f-4e79-9770-0fe51e5f13fc. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.objects.instance [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'migration_context' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.objects.base [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG os_vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b266ed-4f88-5a41-82d7-d5e0d9261db0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598b9806-e5, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap598b9806-e5, col_values=(('qos', UUID('161c54a9-89e7-4edf-94f6-fc67defe6a03')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap598b9806-e5, col_values=(('external_ids', {'iface-id': '598b9806-e561-4d8b-9e33-1e8ec1268b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f5:56', 'vm-uuid': '6f7c5378-aadc-45e4-b3c3-d308e526b03a'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:27 user nova-compute[75266]: INFO os_vif [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:45:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG nova.compute.manager [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG nova.compute.manager [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:29 user nova-compute[75266]: WARNING nova.compute.manager [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state powering-on.
Nov 28 00:45:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG os_brick.utils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d3b7ea-66c5-4d0b-94d7-c1bc03d23380]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[99738b09-c9b3-40a1-bd78-97ebdb738aa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3618281-e1a3-4184-94f5-b34104109700]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee118f-6350-4dcc-973e-4e39229e6051]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:45:31 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d20ce3-3f55-4deb-af99-e66dd98a1401]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG os_brick.utils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating existing volume attachment record: adea6b4b-ecd1-44ff-b0b6-003a7b0ba401 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:31 user nova-compute[75266]: WARNING nova.compute.manager [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state powering-on.
Nov 28 00:45:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:45:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance rebooted successfully.
Nov 28 00:45:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:45:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2619f610-3a3c-4b48-9448-c30d75414e56 is timed out.
Nov 28 00:45:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Successfully detached device vdb from instance 2619f610-3a3c-4b48-9448-c30d75414e56 from the live domain config.
Nov 28 00:45:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaGRsinO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b578e5-efec-4a3e-80a1-d915c9a15d7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:45:32 user nova-compute[75266]: No targets found.
Nov 28 00:45:32 user nova-compute[75266]: iSNS:
Nov 28 00:45:32 user nova-compute[75266]: No targets found.
Nov 28 00:45:32 user nova-compute[75266]: STATIC:
Nov 28 00:45:32 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:45:32 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:45:32 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:45:32 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740
Nov 28 00:45:32 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:45:32 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:45:32 user nova-compute[75266]: FIRMWARE:
Nov 28 00:45:32 user nova-compute[75266]: No targets found.
Nov 28 00:45:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:45:32 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:45:32 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6fe07-9751-4867-9ea3-f9a6885bd87b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb80d73-e59e-47a6-b10b-3b4e914b062b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:32 user nova-compute[75266]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 (non-flash)
Nov 28 00:45:32 user nova-compute[75266]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c3b7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4554d975-b860-441e-b5f2-dee1cc1fb363]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd2488-ed19-4eb0-bce4-4ca38118157f]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a5d4b-f02c-48c7-b81a-994cadb7750e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71bb841-2e03-493c-a15b-a12bbdd1c763]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63a241-a5bb-4955-8b42-e3d4d6081d36]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff66a3-d555-4e54-88e9-f1a99a664bef]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260]
Nov 28 00:45:32 user nova-compute[75266]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740, portal: 172.16.0.220,3260] successful.
Nov 28 00:45:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:690a2933-f2cc-4d04-b41a-41189277b740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f53ab8-11b3-4d39-93d9-2cc4c65a5da3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] <== disconnect_volume: return (314ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:45:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'flavor' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:45:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Creating image(s)
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Ensure instance console log exists: /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start _get_guest_xml network_info=[{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92237bf8-8ea4-4f79-938d-6dfe03edd31d', 'attached_at': '', 'detached_at': '', 'volume_id': '04532fc5-654b-46d5-a1c4-32bbf6318974', 'serial': '04532fc5-654b-46d5-a1c4-32bbf6318974'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'adea6b4b-ecd1-44ff-b0b6-003a7b0ba401', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:45:39 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:39 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:45:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:45:39 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc29fac-e87f-4009-8ad5-6614711fed9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:45:39 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ffb8b-1f0c-4837-95df-3e75f92df464]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974] added
Nov 28 00:45:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c98c710-0d43-48c1-8ff9-e149c517fcba]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aed4cf-339a-4bb2-a841-4c112ac444c5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpnRgKLY {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpnRgKLY" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b62a4-44cc-4de1-ac51-fe40af1b5bbe]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpnRgKLY'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c907ae13-6c4b-44f7-ba2f-cfcc559373b0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78de57-d30a-4546-a736-7e3b98911ca6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --login" returned: 0 in 2.080s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f59162-58bd-4d57-9697-2d1a7a6700c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260]
Nov 28 00:45:41 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260] successful.
Nov 28 00:45:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[67127f99-5035-4996-aa15-7561ed9e39b5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22172b7-d2a3-46b9-a791-627f28c3f42f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:41 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:45:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:45:41 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:45:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.320s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ff43b-22f6-4c3a-acf5-c3d6c32ad944]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:45:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.352s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== connect_volume: return (3353ms) {'type': 'block', 'scsi_wwn': '23162373431326531', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162373431326531', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1413117774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1413117774',id=16,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-7fzl3ejn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:45:25Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=92237bf8-8ea4-4f79-938d-6dfe03edd31d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.objects.instance [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:45:42 user nova-compute[75266]:   <uuid>92237bf8-8ea4-4f79-938d-6dfe03edd31d</uuid>
Nov 28 00:45:42 user nova-compute[75266]:   <name>instance-00000010</name>
Nov 28 00:45:42 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:45:42 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:45:42 user nova-compute[75266]:   <metadata>
Nov 28 00:45:42 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:45:42 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1413117774</nova:name>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:45:39</nova:creationTime>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:45:42 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:45:42 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:owner>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:45:42 user nova-compute[75266]:       </nova:owner>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:45:42 user nova-compute[75266]:       <nova:ports>
Nov 28 00:45:42 user nova-compute[75266]:         <nova:port uuid="d57d7084-7f1f-4e79-9770-0fe51e5f13fc">
Nov 28 00:45:42 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 00:45:42 user nova-compute[75266]:         </nova:port>
Nov 28 00:45:42 user nova-compute[75266]:       </nova:ports>
Nov 28 00:45:42 user nova-compute[75266]:     </nova:instance>
Nov 28 00:45:42 user nova-compute[75266]:   </metadata>
Nov 28 00:45:42 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:45:42 user nova-compute[75266]:     <system>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="serial">92237bf8-8ea4-4f79-938d-6dfe03edd31d</entry>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="uuid">92237bf8-8ea4-4f79-938d-6dfe03edd31d</entry>
Nov 28 00:45:42 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:45:42 user nova-compute[75266]:     </system>
Nov 28 00:45:42 user nova-compute[75266]:   </sysinfo>
Nov 28 00:45:42 user nova-compute[75266]:   <os>
Nov 28 00:45:42 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:45:42 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:45:42 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:45:42 user nova-compute[75266]:   </os>
Nov 28 00:45:42 user nova-compute[75266]:   <features>
Nov 28 00:45:42 user nova-compute[75266]:     <acpi/>
Nov 28 00:45:42 user nova-compute[75266]:     <apic/>
Nov 28 00:45:42 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:45:42 user nova-compute[75266]:   </features>
Nov 28 00:45:42 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:45:42 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:45:42 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:45:42 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:45:42 user nova-compute[75266]:   </clock>
Nov 28 00:45:42 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:45:42 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:45:42 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:45:42 user nova-compute[75266]:   </cpu>
Nov 28 00:45:42 user nova-compute[75266]:   <devices>
Nov 28 00:45:42 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:45:42 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:45:42 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 00:45:42 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:45:42 user nova-compute[75266]:       <serial>04532fc5-654b-46d5-a1c4-32bbf6318974</serial>
Nov 28 00:45:42 user nova-compute[75266]:     </disk>
Nov 28 00:45:42 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:45:42 user nova-compute[75266]:       <mac address="fa:16:3e:9f:c8:ec"/>
Nov 28 00:45:42 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:42 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:45:42 user nova-compute[75266]:       <target dev="tapd57d7084-7f"/>
Nov 28 00:45:42 user nova-compute[75266]:     </interface>
Nov 28 00:45:42 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:45:42 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/console.log" append="off"/>
Nov 28 00:45:42 user nova-compute[75266]:     </serial>
Nov 28 00:45:42 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:45:42 user nova-compute[75266]:     <video>
Nov 28 00:45:42 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:45:42 user nova-compute[75266]:     </video>
Nov 28 00:45:42 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:45:42 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:45:42 user nova-compute[75266]:     </rng>
Nov 28 00:45:42 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:45:42 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:45:42 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:45:42 user nova-compute[75266]:     </memballoon>
Nov 28 00:45:42 user nova-compute[75266]:   </devices>
Nov 28 00:45:42 user nova-compute[75266]: </domain>
Nov 28 00:45:42 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1413117774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1413117774',id=16,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-7fzl3ejn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:45:25Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=92237bf8-8ea4-4f79-938d-6dfe03edd31d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG os_vif [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8d90db8-5d49-5459-a243-a0da64ae1e8a', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd57d7084-7f, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd57d7084-7f, col_values=(('qos', UUID('734176a0-59d4-4a78-b809-6dbf46d90201')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd57d7084-7f, col_values=(('external_ids', {'iface-id': 'd57d7084-7f1f-4e79-9770-0fe51e5f13fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:c8:ec', 'vm-uuid': '92237bf8-8ea4-4f79-938d-6dfe03edd31d'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:42 user nova-compute[75266]: INFO os_vif [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f')
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:45:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:9f:c8:ec, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:44 user nova-compute[75266]: WARNING nova.compute.manager [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state building and task_state spawning.
Nov 28 00:45:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:45:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance spawned successfully.
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:45:46 user nova-compute[75266]: WARNING nova.compute.manager [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state building and task_state spawning.
Nov 28 00:45:46 user nova-compute[75266]: INFO nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 28 00:45:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:45:46 user nova-compute[75266]: INFO nova.compute.manager [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Took 22.38 seconds to build instance.
Nov 28 00:45:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.495s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:45:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:45:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:06 user nova-compute[75266]: INFO nova.compute.manager [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Terminating instance
Nov 28 00:46:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-unplugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] No waiting events found dispatching network-vif-unplugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-unplugged-8482d7a1-9b99-461b-aff7-9748c14d2529 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:46:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Instance destroyed successfully.
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'resources' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1773137',id=12,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDV9oRV1wyim0sPI9SAlyevLGDgoxJX4WmEfY5ypsISajiixGHb150bg76nB7Ak8q1IJt+UTv38X7TheRdTKeSv00fCBixae2T3atzjMnCzv6q0GKf0tAXto0fhbm1Yaw==',key_name='tempest-keypair-867180318',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a97779a519d04d8bb60a0dfcfd23f347',ramdisk_id='',reservation_id='r-u29ylxvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6f5f016eeb4e1fbb54d8b4163a1e69',uuid=2619f610-3a3c-4b48-9448-c30d75414e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converting VIF {"id": "8482d7a1-9b99-461b-aff7-9748c14d2529", "address": "fa:16:3e:a4:e6:b7", "network": {"id": "8e478814-6a3e-4ff6-8faa-dce421e62eaa", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-656037647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a97779a519d04d8bb60a0dfcfd23f347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8482d7a1-9b", "ovs_interfaceid": "8482d7a1-9b99-461b-aff7-9748c14d2529", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG os_vif [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8482d7a1-9b, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=151da299-6ff6-4206-be40-5e39ea49cc7e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:07 user nova-compute[75266]: INFO os_vif [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:e6:b7,bridge_name='br-int',has_traffic_filtering=True,id=8482d7a1-9b99-461b-aff7-9748c14d2529,network=Network(8e478814-6a3e-4ff6-8faa-dce421e62eaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8482d7a1-9b')
Nov 28 00:46:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Deleting instance files /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56_del
Nov 28 00:46:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Deletion of /opt/stack/data/nova/instances/2619f610-3a3c-4b48-9448-c30d75414e56_del complete
Nov 28 00:46:07 user nova-compute[75266]: INFO nova.compute.manager [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 28 00:46:07 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:46:07 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:46:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:08 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:08 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Took 1.23 seconds to deallocate network for instance.
Nov 28 00:46:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Acquiring lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Lock "2619f610-3a3c-4b48-9448-c30d75414e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] No waiting events found dispatching network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:09 user nova-compute[75266]: WARNING nova.compute.manager [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received unexpected event network-vif-plugged-8482d7a1-9b99-461b-aff7-9748c14d2529 for instance with vm_state deleted and task_state None.
Nov 28 00:46:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Received event network-vif-deleted-8482d7a1-9b99-461b-aff7-9748c14d2529 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:09 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Deleted allocations for instance 2619f610-3a3c-4b48-9448-c30d75414e56
Nov 28 00:46:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "2619f610-3a3c-4b48-9448-c30d75414e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:11 user nova-compute[75266]: INFO nova.compute.manager [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Rescuing
Nov 28 00:46:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:12 user nova-compute[75266]: WARNING nova.compute.manager [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance destroyed successfully.
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Attempting rescue
Nov 28 00:46:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:46:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Creating image(s)
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue" returned: 0 in 0.085s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'migration_context' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<bf245d26-e901-4fca-8ff5-a3558974294b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start _get_guest_xml network_info=[{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:f4:e8:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<bf245d26-e901-4fca-8ff5-a3558974294b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'numa_topology' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<bf245d26-e901-4fca-8ff5-a3558974294b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:46:13 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:13 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<bf245d26-e901-4fca-8ff5-a3558974294b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-368791726',display_name='tempest-ServerRescueNegativeTestJSON-server-368791726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-368791726',id=2,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-v0cnts0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:41:47Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=bf245d26-e901-4fca-8ff5-a3558974294b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:f4:e8:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:f4:e8:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<bf245d26-e901-4fca-8ff5-a3558974294b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:46:13 user nova-compute[75266]:   <uuid>bf245d26-e901-4fca-8ff5-a3558974294b</uuid>
Nov 28 00:46:13 user nova-compute[75266]:   <name>instance-00000002</name>
Nov 28 00:46:13 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:46:13 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:46:13 user nova-compute[75266]:   <metadata>
Nov 28 00:46:13 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:46:13 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-368791726</nova:name>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:46:13</nova:creationTime>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:46:13 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:46:13 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:owner>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:46:13 user nova-compute[75266]:       </nova:owner>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:46:13 user nova-compute[75266]:       <nova:ports>
Nov 28 00:46:13 user nova-compute[75266]:         <nova:port uuid="5d492cfb-25b6-4b28-b279-bd2f648c39f3">
Nov 28 00:46:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 00:46:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:46:13 user nova-compute[75266]:       </nova:ports>
Nov 28 00:46:13 user nova-compute[75266]:     </nova:instance>
Nov 28 00:46:13 user nova-compute[75266]:   </metadata>
Nov 28 00:46:13 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:46:13 user nova-compute[75266]:     <system>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="serial">bf245d26-e901-4fca-8ff5-a3558974294b</entry>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="uuid">bf245d26-e901-4fca-8ff5-a3558974294b</entry>
Nov 28 00:46:13 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:46:13 user nova-compute[75266]:     </system>
Nov 28 00:46:13 user nova-compute[75266]:   </sysinfo>
Nov 28 00:46:13 user nova-compute[75266]:   <os>
Nov 28 00:46:13 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:46:13 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:46:13 user nova-compute[75266]:   </os>
Nov 28 00:46:13 user nova-compute[75266]:   <features>
Nov 28 00:46:13 user nova-compute[75266]:     <acpi/>
Nov 28 00:46:13 user nova-compute[75266]:     <apic/>
Nov 28 00:46:13 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:46:13 user nova-compute[75266]:   </features>
Nov 28 00:46:13 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:46:13 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:46:13 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:46:13 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:46:13 user nova-compute[75266]:   </clock>
Nov 28 00:46:13 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:46:13 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:46:13 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:46:13 user nova-compute[75266]:   </cpu>
Nov 28 00:46:13 user nova-compute[75266]:   <devices>
Nov 28 00:46:13 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:46:13 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:46:13 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue"/>
Nov 28 00:46:13 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:46:13 user nova-compute[75266]:     </disk>
Nov 28 00:46:13 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:46:13 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:46:13 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk"/>
Nov 28 00:46:13 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:46:13 user nova-compute[75266]:     </disk>
Nov 28 00:46:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:46:13 user nova-compute[75266]:       <mac address="fa:16:3e:f4:e8:58"/>
Nov 28 00:46:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:46:13 user nova-compute[75266]:       <target dev="tap5d492cfb-25"/>
Nov 28 00:46:13 user nova-compute[75266]:     </interface>
Nov 28 00:46:13 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:46:13 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/console.log" append="off"/>
Nov 28 00:46:13 user nova-compute[75266]:     </serial>
Nov 28 00:46:13 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:46:13 user nova-compute[75266]:     <video>
Nov 28 00:46:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:13 user nova-compute[75266]:     </video>
Nov 28 00:46:13 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:46:13 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:46:13 user nova-compute[75266]:     </rng>
Nov 28 00:46:13 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:46:13 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:46:13 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:46:13 user nova-compute[75266]:     </memballoon>
Nov 28 00:46:13 user nova-compute[75266]:   </devices>
Nov 28 00:46:13 user nova-compute[75266]: </domain>
Nov 28 00:46:13 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:46:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance destroyed successfully.
Nov 28 00:46:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:f4:e8:58, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:46:13 user nova-compute[75266]: INFO nova.compute.claims [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Claim successful on node user
Nov 28 00:46:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:46:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.policy [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8dd53f8dd874658a31a1aaf40a4091e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e19068366934d7db3a2cb3131af5498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:14 user nova-compute[75266]: WARNING nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:14 user nova-compute[75266]: WARNING nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:14 user nova-compute[75266]: WARNING nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:14 user nova-compute[75266]: WARNING nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:14 user nova-compute[75266]: WARNING nova.compute.manager [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:46:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Creating image(s)
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "/opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "/opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.238s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Successfully created port: 79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.290s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk 1073741824" returned: 0 in 0.066s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Cannot resize image /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Ensure instance console log exists: /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Successfully updated port: 79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquired lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:16 user nova-compute[75266]: WARNING nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:16 user nova-compute[75266]: WARNING nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state rescuing.
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-changed-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Refreshing instance network info cache due to event network-changed-79f0240f-a11e-4733-adaa-4a5f4b2ae450. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Acquiring lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updating instance_info_cache with network_info: [{"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Releasing lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Instance network_info: |[{"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Acquired lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.neutron [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Refreshing network info cache for port 79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Start _get_guest_xml network_info=[{"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:46:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-164256632',display_name='tempest-DeleteServersTestJSON-server-164256632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-164256632',id=17,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e19068366934d7db3a2cb3131af5498',ramdisk_id='',reservation_id='r-refa2hah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1600931395',owner_user_name='tempest-DeleteServersTestJSON-1600931395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:15Z,user_data=None,user_id='b8dd53f8dd874658a31a1aaf40a4091e',uuid=c8307b4a-ad04-4830-9752-5157af5a4f3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converting VIF {"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lazy-loading 'pci_devices' on Instance uuid c8307b4a-ad04-4830-9752-5157af5a4f3b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:46:16 user nova-compute[75266]:   <uuid>c8307b4a-ad04-4830-9752-5157af5a4f3b</uuid>
Nov 28 00:46:16 user nova-compute[75266]:   <name>instance-00000011</name>
Nov 28 00:46:16 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:46:16 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:46:16 user nova-compute[75266]:   <metadata>
Nov 28 00:46:16 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:46:16 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:name>tempest-DeleteServersTestJSON-server-164256632</nova:name>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:46:16</nova:creationTime>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:46:16 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:46:16 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:owner>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:user uuid="b8dd53f8dd874658a31a1aaf40a4091e">tempest-DeleteServersTestJSON-1600931395-project-member</nova:user>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:project uuid="3e19068366934d7db3a2cb3131af5498">tempest-DeleteServersTestJSON-1600931395</nova:project>
Nov 28 00:46:16 user nova-compute[75266]:       </nova:owner>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:46:16 user nova-compute[75266]:       <nova:ports>
Nov 28 00:46:16 user nova-compute[75266]:         <nova:port uuid="79f0240f-a11e-4733-adaa-4a5f4b2ae450">
Nov 28 00:46:16 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 00:46:16 user nova-compute[75266]:         </nova:port>
Nov 28 00:46:16 user nova-compute[75266]:       </nova:ports>
Nov 28 00:46:16 user nova-compute[75266]:     </nova:instance>
Nov 28 00:46:16 user nova-compute[75266]:   </metadata>
Nov 28 00:46:16 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:46:16 user nova-compute[75266]:     <system>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="serial">c8307b4a-ad04-4830-9752-5157af5a4f3b</entry>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="uuid">c8307b4a-ad04-4830-9752-5157af5a4f3b</entry>
Nov 28 00:46:16 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:46:16 user nova-compute[75266]:     </system>
Nov 28 00:46:16 user nova-compute[75266]:   </sysinfo>
Nov 28 00:46:16 user nova-compute[75266]:   <os>
Nov 28 00:46:16 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:46:16 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:46:16 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:46:16 user nova-compute[75266]:   </os>
Nov 28 00:46:16 user nova-compute[75266]:   <features>
Nov 28 00:46:16 user nova-compute[75266]:     <acpi/>
Nov 28 00:46:16 user nova-compute[75266]:     <apic/>
Nov 28 00:46:16 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:46:16 user nova-compute[75266]:   </features>
Nov 28 00:46:16 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:46:16 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:46:16 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:46:16 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:46:16 user nova-compute[75266]:   </clock>
Nov 28 00:46:16 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:46:16 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:46:16 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:46:16 user nova-compute[75266]:   </cpu>
Nov 28 00:46:16 user nova-compute[75266]:   <devices>
Nov 28 00:46:16 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:46:16 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:46:16 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk"/>
Nov 28 00:46:16 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:46:16 user nova-compute[75266]:     </disk>
Nov 28 00:46:16 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:46:16 user nova-compute[75266]:       <mac address="fa:16:3e:f5:d5:9c"/>
Nov 28 00:46:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:16 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:46:16 user nova-compute[75266]:       <target dev="tap79f0240f-a1"/>
Nov 28 00:46:16 user nova-compute[75266]:     </interface>
Nov 28 00:46:16 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:46:16 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/console.log" append="off"/>
Nov 28 00:46:16 user nova-compute[75266]:     </serial>
Nov 28 00:46:16 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:46:16 user nova-compute[75266]:     <video>
Nov 28 00:46:16 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:16 user nova-compute[75266]:     </video>
Nov 28 00:46:16 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:46:16 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:46:16 user nova-compute[75266]:     </rng>
Nov 28 00:46:16 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:46:16 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:46:16 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:46:16 user nova-compute[75266]:     </memballoon>
Nov 28 00:46:16 user nova-compute[75266]:   </devices>
Nov 28 00:46:16 user nova-compute[75266]: </domain>
Nov 28 00:46:16 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-164256632',display_name='tempest-DeleteServersTestJSON-server-164256632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-164256632',id=17,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e19068366934d7db3a2cb3131af5498',ramdisk_id='',reservation_id='r-refa2hah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1600931395',owner_user_name='tempest-DeleteServersTestJSON-1600931395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:15Z,user_data=None,user_id='b8dd53f8dd874658a31a1aaf40a4091e',uuid=c8307b4a-ad04-4830-9752-5157af5a4f3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converting VIF {"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG os_vif [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71ac040a-6434-5553-aeac-191216fe0381', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79f0240f-a1, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79f0240f-a1, col_values=(('qos', UUID('436da3a0-71d1-48ba-9cfb-2e86d2350e11')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79f0240f-a1, col_values=(('external_ids', {'iface-id': '79f0240f-a11e-4733-adaa-4a5f4b2ae450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d5:9c', 'vm-uuid': 'c8307b4a-ad04-4830-9752-5157af5a4f3b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:17 user nova-compute[75266]: INFO os_vif [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1')
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] No VIF found with MAC fa:16:3e:f5:d5:9c, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updated VIF entry in instance network info cache for port 79f0240f-a11e-4733-adaa-4a5f4b2ae450. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updating instance_info_cache with network_info: [{"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Releasing lock "refresh_cache-c8307b4a-ad04-4830-9752-5157af5a4f3b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json" returned: 0 in 0.405s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] No waiting events found dispatching network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:19 user nova-compute[75266]: WARNING nova.compute.manager [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received unexpected event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance with vm_state building and task_state spawning.
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] No waiting events found dispatching network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:21 user nova-compute[75266]: WARNING nova.compute.manager [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received unexpected event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance with vm_state building and task_state spawning.
Nov 28 00:46:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.41283416748047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Instance spawned successfully.
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:22 user nova-compute[75266]: INFO nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c8307b4a-ad04-4830-9752-5157af5a4f3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:46:22 user nova-compute[75266]: INFO nova.compute.manager [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Took 8.66 seconds to build instance.
Nov 28 00:46:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.802s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:46:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:46:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:46:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:42 user nova-compute[75266]: INFO nova.compute.manager [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Terminating instance
Nov 28 00:46:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Instance destroyed successfully.
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'resources' on Instance uuid d9e00566-f7d4-4022-9377-94fcb8f54fd3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-690874260',display_name='tempest-VolumesAdminNegativeTest-server-690874260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-690874260',id=14,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-h8t0alp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:44:51Z,user_data=None,user_id='6657488fa71b469c954276af7717308e',uuid=d9e00566-f7d4-4022-9377-94fcb8f54fd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "09f3cea2-142d-4c24-8c21-27880492615b", "address": "fa:16:3e:c2:19:f0", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09f3cea2-14", "ovs_interfaceid": "09f3cea2-142d-4c24-8c21-27880492615b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG os_vif [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09f3cea2-14, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3f52968-8b97-4791-9915-fad334f4a9eb) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:43 user nova-compute[75266]: INFO os_vif [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:19:f0,bridge_name='br-int',has_traffic_filtering=True,id=09f3cea2-142d-4c24-8c21-27880492615b,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09f3cea2-14')
Nov 28 00:46:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Deleting instance files /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3_del
Nov 28 00:46:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Deletion of /opt/stack/data/nova/instances/d9e00566-f7d4-4022-9377-94fcb8f54fd3_del complete
Nov 28 00:46:43 user nova-compute[75266]: INFO nova.compute.manager [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 00:46:43 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:46:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:44 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:44 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Took 1.23 seconds to deallocate network for instance.
Nov 28 00:46:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Received event network-vif-deleted-09f3cea2-142d-4c24-8c21-27880492615b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:45 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Deleted allocations for instance d9e00566-f7d4-4022-9377-94fcb8f54fd3
Nov 28 00:46:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "d9e00566-f7d4-4022-9377-94fcb8f54fd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:46:49 user nova-compute[75266]: INFO nova.compute.claims [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Claim successful on node user
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:46:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:46:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG nova.policy [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:46:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Creating image(s)
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.214s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk 1073741824" returned: 0 in 0.064s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Successfully created port: 9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.250s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:46:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Cannot resize image /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Ensure instance console log exists: /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Successfully updated port: 9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-changed-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Refreshing instance network info cache due to event network-changed-9c1755ff-555e-44fa-8082-fceddb0ee343. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:46:51 user nova-compute[75266]: INFO nova.compute.claims [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Claim successful on node user
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance network_info: |[{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Refreshing network info cache for port 9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start _get_guest_xml network_info=[{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:46:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'pci_devices' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:46:52 user nova-compute[75266]:   <uuid>41828b32-f570-4428-8064-5c199a898a04</uuid>
Nov 28 00:46:52 user nova-compute[75266]:   <name>instance-00000012</name>
Nov 28 00:46:52 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:46:52 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:46:52 user nova-compute[75266]:   <metadata>
Nov 28 00:46:52 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:46:52 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherB-server-1577106707</nova:name>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:46:52</nova:creationTime>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:46:52 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:46:52 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:owner>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:user uuid="e626332697e34a0ba733c723a5ecb328">tempest-ServerActionsTestOtherB-1824523225-project-member</nova:user>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:project uuid="b57f21cfce3044c5aad7192a64ce2d8a">tempest-ServerActionsTestOtherB-1824523225</nova:project>
Nov 28 00:46:52 user nova-compute[75266]:       </nova:owner>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:46:52 user nova-compute[75266]:       <nova:ports>
Nov 28 00:46:52 user nova-compute[75266]:         <nova:port uuid="9c1755ff-555e-44fa-8082-fceddb0ee343">
Nov 28 00:46:52 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:46:52 user nova-compute[75266]:         </nova:port>
Nov 28 00:46:52 user nova-compute[75266]:       </nova:ports>
Nov 28 00:46:52 user nova-compute[75266]:     </nova:instance>
Nov 28 00:46:52 user nova-compute[75266]:   </metadata>
Nov 28 00:46:52 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:46:52 user nova-compute[75266]:     <system>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="serial">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="uuid">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:46:52 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:46:52 user nova-compute[75266]:     </system>
Nov 28 00:46:52 user nova-compute[75266]:   </sysinfo>
Nov 28 00:46:52 user nova-compute[75266]:   <os>
Nov 28 00:46:52 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:46:52 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:46:52 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:46:52 user nova-compute[75266]:   </os>
Nov 28 00:46:52 user nova-compute[75266]:   <features>
Nov 28 00:46:52 user nova-compute[75266]:     <acpi/>
Nov 28 00:46:52 user nova-compute[75266]:     <apic/>
Nov 28 00:46:52 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:46:52 user nova-compute[75266]:   </features>
Nov 28 00:46:52 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:46:52 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:46:52 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:46:52 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:46:52 user nova-compute[75266]:   </clock>
Nov 28 00:46:52 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:46:52 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:46:52 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:46:52 user nova-compute[75266]:   </cpu>
Nov 28 00:46:52 user nova-compute[75266]:   <devices>
Nov 28 00:46:52 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:46:52 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:46:52 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk"/>
Nov 28 00:46:52 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:46:52 user nova-compute[75266]:     </disk>
Nov 28 00:46:52 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:46:52 user nova-compute[75266]:       <mac address="fa:16:3e:e3:c0:e9"/>
Nov 28 00:46:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:52 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:46:52 user nova-compute[75266]:       <target dev="tap9c1755ff-55"/>
Nov 28 00:46:52 user nova-compute[75266]:     </interface>
Nov 28 00:46:52 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:46:52 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/console.log" append="off"/>
Nov 28 00:46:52 user nova-compute[75266]:     </serial>
Nov 28 00:46:52 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:46:52 user nova-compute[75266]:     <video>
Nov 28 00:46:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:52 user nova-compute[75266]:     </video>
Nov 28 00:46:52 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:46:52 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:46:52 user nova-compute[75266]:     </rng>
Nov 28 00:46:52 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:46:52 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:46:52 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:46:52 user nova-compute[75266]:     </memballoon>
Nov 28 00:46:52 user nova-compute[75266]:   </devices>
Nov 28 00:46:52 user nova-compute[75266]: </domain>
Nov 28 00:46:52 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG os_vif [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96741050-df23-5933-82ff-a74e70923eb3', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1755ff-55, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1755ff-55, col_values=(('qos', UUID('9475bfd1-1ba0-4f0a-aec8-d56d7e9eb2b4')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1755ff-55, col_values=(('external_ids', {'iface-id': '9c1755ff-555e-44fa-8082-fceddb0ee343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:c0:e9', 'vm-uuid': '41828b32-f570-4428-8064-5c199a898a04'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:52 user nova-compute[75266]: INFO os_vif [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No VIF found with MAC fa:16:3e:e3:c0:e9, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:46:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.policy [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4a78fd7893c4c17acd06b280542b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ab8531e1e740798cff8ce9dd2cb311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:46:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Creating image(s)
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "/opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "/opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updated VIF entry in instance network info cache for port 9c1755ff-555e-44fa-8082-fceddb0ee343. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.210s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk 1073741824" returned: 0 in 0.052s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Successfully created port: 65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Cannot resize image /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Successfully updated port: 65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquired lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-changed-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Refreshing instance network info cache due to event network-changed-65e249eb-8337-4f50-b643-927be5058f5e. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Acquiring lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating instance_info_cache with network_info: [{"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Releasing lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Instance network_info: |[{"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Acquired lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Refreshing network info cache for port 65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Start _get_guest_xml network_info=[{"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:46:54 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:54 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:46:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-159767708',display_name='tempest-SnapshotDataIntegrityTests-server-159767708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-159767708',id=19,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQT93B1uIu5X8ATFza/6QgBPFdK/6Mj2vlay+fJdO/NuBhwWV8F2g3oDnIf2Cvqh9Pygmd8ZgZE5MRMhTiHjAmoHx0hy5rIBY0Xs3DmMePM0qt2SWEAhGwI0quO8mHUaA==',key_name='tempest-keypair-213731965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ab8531e1e740798cff8ce9dd2cb311',ramdisk_id='',reservation_id='r-fsdh7hqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1920079985',owner_user_name='tempest-SnapshotDataIntegrityTests-1920079985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4a78fd7893c4c17acd06b280542b631',uuid=0fc5430b-5c2a-4074-886e-d53482cb2bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converting VIF {"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:46:55 user nova-compute[75266]:   <uuid>0fc5430b-5c2a-4074-886e-d53482cb2bb9</uuid>
Nov 28 00:46:55 user nova-compute[75266]:   <name>instance-00000013</name>
Nov 28 00:46:55 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:46:55 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:46:55 user nova-compute[75266]:   <metadata>
Nov 28 00:46:55 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:46:55 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-159767708</nova:name>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:46:54</nova:creationTime>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:46:55 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:46:55 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:owner>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:user uuid="a4a78fd7893c4c17acd06b280542b631">tempest-SnapshotDataIntegrityTests-1920079985-project-member</nova:user>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:project uuid="68ab8531e1e740798cff8ce9dd2cb311">tempest-SnapshotDataIntegrityTests-1920079985</nova:project>
Nov 28 00:46:55 user nova-compute[75266]:       </nova:owner>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:46:55 user nova-compute[75266]:       <nova:ports>
Nov 28 00:46:55 user nova-compute[75266]:         <nova:port uuid="65e249eb-8337-4f50-b643-927be5058f5e">
Nov 28 00:46:55 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 00:46:55 user nova-compute[75266]:         </nova:port>
Nov 28 00:46:55 user nova-compute[75266]:       </nova:ports>
Nov 28 00:46:55 user nova-compute[75266]:     </nova:instance>
Nov 28 00:46:55 user nova-compute[75266]:   </metadata>
Nov 28 00:46:55 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:46:55 user nova-compute[75266]:     <system>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="serial">0fc5430b-5c2a-4074-886e-d53482cb2bb9</entry>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="uuid">0fc5430b-5c2a-4074-886e-d53482cb2bb9</entry>
Nov 28 00:46:55 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:46:55 user nova-compute[75266]:     </system>
Nov 28 00:46:55 user nova-compute[75266]:   </sysinfo>
Nov 28 00:46:55 user nova-compute[75266]:   <os>
Nov 28 00:46:55 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:46:55 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:46:55 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:46:55 user nova-compute[75266]:   </os>
Nov 28 00:46:55 user nova-compute[75266]:   <features>
Nov 28 00:46:55 user nova-compute[75266]:     <acpi/>
Nov 28 00:46:55 user nova-compute[75266]:     <apic/>
Nov 28 00:46:55 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:46:55 user nova-compute[75266]:   </features>
Nov 28 00:46:55 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:46:55 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:46:55 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:46:55 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:46:55 user nova-compute[75266]:   </clock>
Nov 28 00:46:55 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:46:55 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:46:55 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:46:55 user nova-compute[75266]:   </cpu>
Nov 28 00:46:55 user nova-compute[75266]:   <devices>
Nov 28 00:46:55 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:46:55 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:46:55 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk"/>
Nov 28 00:46:55 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:46:55 user nova-compute[75266]:     </disk>
Nov 28 00:46:55 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:46:55 user nova-compute[75266]:       <mac address="fa:16:3e:d1:c0:61"/>
Nov 28 00:46:55 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:55 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:46:55 user nova-compute[75266]:       <target dev="tap65e249eb-83"/>
Nov 28 00:46:55 user nova-compute[75266]:     </interface>
Nov 28 00:46:55 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:46:55 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/console.log" append="off"/>
Nov 28 00:46:55 user nova-compute[75266]:     </serial>
Nov 28 00:46:55 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:46:55 user nova-compute[75266]:     <video>
Nov 28 00:46:55 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:46:55 user nova-compute[75266]:     </video>
Nov 28 00:46:55 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:46:55 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:46:55 user nova-compute[75266]:     </rng>
Nov 28 00:46:55 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:46:55 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:46:55 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:46:55 user nova-compute[75266]:     </memballoon>
Nov 28 00:46:55 user nova-compute[75266]:   </devices>
Nov 28 00:46:55 user nova-compute[75266]: </domain>
Nov 28 00:46:55 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-159767708',display_name='tempest-SnapshotDataIntegrityTests-server-159767708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-159767708',id=19,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQT93B1uIu5X8ATFza/6QgBPFdK/6Mj2vlay+fJdO/NuBhwWV8F2g3oDnIf2Cvqh9Pygmd8ZgZE5MRMhTiHjAmoHx0hy5rIBY0Xs3DmMePM0qt2SWEAhGwI0quO8mHUaA==',key_name='tempest-keypair-213731965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ab8531e1e740798cff8ce9dd2cb311',ramdisk_id='',reservation_id='r-fsdh7hqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1920079985',owner_user_name='tempest-SnapshotDataIntegrityTests-1920079985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4a78fd7893c4c17acd06b280542b631',uuid=0fc5430b-5c2a-4074-886e-d53482cb2bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converting VIF {"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG os_vif [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76afd4fa-23c1-5559-b4d2-18ec9c17cb5b', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65e249eb-83, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65e249eb-83, col_values=(('qos', UUID('adddbb40-2a2b-4509-a6b9-77c1a2c2193b')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65e249eb-83, col_values=(('external_ids', {'iface-id': '65e249eb-8337-4f50-b643-927be5058f5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c0:61', 'vm-uuid': '0fc5430b-5c2a-4074-886e-d53482cb2bb9'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: INFO os_vif [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83')
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No VIF found with MAC fa:16:3e:d1:c0:61, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updated VIF entry in instance network info cache for port 65e249eb-8337-4f50-b643-927be5058f5e. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating instance_info_cache with network_info: [{"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:46:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Releasing lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:46:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance spawned successfully.
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:56 user nova-compute[75266]: WARNING nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state building and task_state spawning.
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:56 user nova-compute[75266]: WARNING nova.compute.manager [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state building and task_state spawning.
Nov 28 00:46:56 user nova-compute[75266]: INFO nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:46:56 user nova-compute[75266]: INFO nova.compute.manager [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Took 7.20 seconds to build instance.
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.359s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] No waiting events found dispatching network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:56 user nova-compute[75266]: WARNING nova.compute.manager [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received unexpected event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e for instance with vm_state building and task_state spawning.
Nov 28 00:46:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] No waiting events found dispatching network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:46:59 user nova-compute[75266]: WARNING nova.compute.manager [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received unexpected event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e for instance with vm_state building and task_state spawning.
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:46:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Instance spawned successfully.
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:46:59 user nova-compute[75266]: INFO nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 28 00:46:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:46:59 user nova-compute[75266]: INFO nova.compute.manager [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Took 7.61 seconds to build instance.
Nov 28 00:46:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.724s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:47:01 user nova-compute[75266]: INFO nova.compute.claims [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Claim successful on node user
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:47:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.policy [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:47:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Creating image(s)
Nov 28 00:47:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "/opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "/opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.246s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk 1073741824" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.213s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Cannot resize image /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Ensure instance console log exists: /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Successfully created port: 9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Successfully updated port: 9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquired lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-changed-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Refreshing instance network info cache due to event network-changed-9a83bf89-f8f9-4fc2-9097-829795f361cd. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Acquiring lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Updating instance_info_cache with network_info: [{"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Releasing lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Instance network_info: |[{"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Acquired lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.neutron [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Refreshing network info cache for port 9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Start _get_guest_xml network_info=[{"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:47:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1991590042',display_name='tempest-VolumesActionsTest-instance-1991590042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1991590042',id=20,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-apj4iq0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:03Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=d1074b86-5b6a-4d85-a028-ae52d079467f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lazy-loading 'pci_devices' on Instance uuid d1074b86-5b6a-4d85-a028-ae52d079467f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:47:05 user nova-compute[75266]:   <uuid>d1074b86-5b6a-4d85-a028-ae52d079467f</uuid>
Nov 28 00:47:05 user nova-compute[75266]:   <name>instance-00000014</name>
Nov 28 00:47:05 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:47:05 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:47:05 user nova-compute[75266]:   <metadata>
Nov 28 00:47:05 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:47:05 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:name>tempest-VolumesActionsTest-instance-1991590042</nova:name>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:47:04</nova:creationTime>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:47:05 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:47:05 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:owner>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:user uuid="f1d154145c6944a790da943c75adb000">tempest-VolumesActionsTest-1457578131-project-member</nova:user>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:project uuid="6dfd77666ef94a61b16d07a624036091">tempest-VolumesActionsTest-1457578131</nova:project>
Nov 28 00:47:05 user nova-compute[75266]:       </nova:owner>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:47:05 user nova-compute[75266]:       <nova:ports>
Nov 28 00:47:05 user nova-compute[75266]:         <nova:port uuid="9a83bf89-f8f9-4fc2-9097-829795f361cd">
Nov 28 00:47:05 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:47:05 user nova-compute[75266]:         </nova:port>
Nov 28 00:47:05 user nova-compute[75266]:       </nova:ports>
Nov 28 00:47:05 user nova-compute[75266]:     </nova:instance>
Nov 28 00:47:05 user nova-compute[75266]:   </metadata>
Nov 28 00:47:05 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:47:05 user nova-compute[75266]:     <system>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="serial">d1074b86-5b6a-4d85-a028-ae52d079467f</entry>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="uuid">d1074b86-5b6a-4d85-a028-ae52d079467f</entry>
Nov 28 00:47:05 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:47:05 user nova-compute[75266]:     </system>
Nov 28 00:47:05 user nova-compute[75266]:   </sysinfo>
Nov 28 00:47:05 user nova-compute[75266]:   <os>
Nov 28 00:47:05 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:47:05 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:47:05 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:47:05 user nova-compute[75266]:   </os>
Nov 28 00:47:05 user nova-compute[75266]:   <features>
Nov 28 00:47:05 user nova-compute[75266]:     <acpi/>
Nov 28 00:47:05 user nova-compute[75266]:     <apic/>
Nov 28 00:47:05 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:47:05 user nova-compute[75266]:   </features>
Nov 28 00:47:05 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:47:05 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:47:05 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:47:05 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:47:05 user nova-compute[75266]:   </clock>
Nov 28 00:47:05 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:47:05 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:47:05 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:47:05 user nova-compute[75266]:   </cpu>
Nov 28 00:47:05 user nova-compute[75266]:   <devices>
Nov 28 00:47:05 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:47:05 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:47:05 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk"/>
Nov 28 00:47:05 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:47:05 user nova-compute[75266]:     </disk>
Nov 28 00:47:05 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:47:05 user nova-compute[75266]:       <mac address="fa:16:3e:41:61:0f"/>
Nov 28 00:47:05 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:05 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:47:05 user nova-compute[75266]:       <target dev="tap9a83bf89-f8"/>
Nov 28 00:47:05 user nova-compute[75266]:     </interface>
Nov 28 00:47:05 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:47:05 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/console.log" append="off"/>
Nov 28 00:47:05 user nova-compute[75266]:     </serial>
Nov 28 00:47:05 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:47:05 user nova-compute[75266]:     <video>
Nov 28 00:47:05 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:05 user nova-compute[75266]:     </video>
Nov 28 00:47:05 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:47:05 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:47:05 user nova-compute[75266]:     </rng>
Nov 28 00:47:05 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:47:05 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:47:05 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:47:05 user nova-compute[75266]:     </memballoon>
Nov 28 00:47:05 user nova-compute[75266]:   </devices>
Nov 28 00:47:05 user nova-compute[75266]: </domain>
Nov 28 00:47:05 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1991590042',display_name='tempest-VolumesActionsTest-instance-1991590042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1991590042',id=20,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-apj4iq0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:03Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=d1074b86-5b6a-4d85-a028-ae52d079467f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG os_vif [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb51c3d-d69a-5079-b9b4-81d2785ecc42', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a83bf89-f8, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a83bf89-f8, col_values=(('qos', UUID('47ad0851-4fbb-4fdb-9b3b-9c11ff30025a')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a83bf89-f8, col_values=(('external_ids', {'iface-id': '9a83bf89-f8f9-4fc2-9097-829795f361cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:61:0f', 'vm-uuid': 'd1074b86-5b6a-4d85-a028-ae52d079467f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: INFO os_vif [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8')
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] No VIF found with MAC fa:16:3e:41:61:0f, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Updated VIF entry in instance network info cache for port 9a83bf89-f8f9-4fc2-9097-829795f361cd. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Updating instance_info_cache with network_info: [{"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Releasing lock "refresh_cache-d1074b86-5b6a-4d85-a028-ae52d079467f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-changed-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Refreshing instance network info cache due to event network-changed-85cfd155-656c-4678-9381-9603640b1bd4. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Acquiring lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Acquired lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Refreshing network info cache for port 85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'flavor' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updated VIF entry in instance network info cache for port 85cfd155-656c-4678-9381-9603640b1bd4. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating instance_info_cache with network_info: [{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Releasing lock "refresh_cache-ccbf5fa2-6207-49fd-9cca-127fb0358d08" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:06 user nova-compute[75266]: INFO nova.compute.manager [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attaching volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 to /dev/vdb
Nov 28 00:47:06 user nova-compute[75266]: DEBUG os_brick.utils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] No waiting events found dispatching network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:06 user nova-compute[75266]: WARNING nova.compute.manager [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received unexpected event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd for instance with vm_state building and task_state spawning.
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5fb22-76d3-4120-b0e5-6dfd494e88f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fbcc08-87dd-4f7e-9ff5-dfaee3ea23af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5df074-65a9-44cd-8193-3c4fdc1178d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acfcd2a-1335-45d1-b3ab-d1f4e4a427bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:47:07 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:47:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f682378-41a7-4cb7-8701-21a76871c333]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG os_brick.utils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating existing volume attachment record: 486f5d3d-4e0c-4559-9a57-be28b7f6004f {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] No waiting events found dispatching network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:09 user nova-compute[75266]: WARNING nova.compute.manager [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received unexpected event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd for instance with vm_state building and task_state spawning.
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:47:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Instance spawned successfully.
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:09 user nova-compute[75266]: INFO nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 28 00:47:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:09 user nova-compute[75266]: INFO nova.compute.manager [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Took 7.41 seconds to build instance.
Nov 28 00:47:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.519s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:14 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:14 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:14 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafb354-4f55-4004-a340-f49085db6ef0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:47:14 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83e695-b2d9-4282-89cc-14fa5aabfa84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05] added
Nov 28 00:47:14 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4a67a-a5b0-4208-9fed-bff9b3f8fcf1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[430856b5-16c1-4402-afb7-14ab7a5e62f6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqYiSZQT {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqYiSZQT" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a991a6bd-b04d-4cc0-b00d-79d8d6eab964]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqYiSZQT'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185d1e1-eb01-434d-83d9-2303af9e23c5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792fe04-69fb-45a8-ab9f-73f61c738fa2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f3e8c-f111-4c82-8920-e13de7f5e1ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]
Nov 28 00:47:15 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.
Nov 28 00:47:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b7680-77f4-44d8-b3ce-7cfeadc22fd5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6495f3b-90fe-4987-b9a4-93011653ce11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:15 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac4529-a945-461c-92ff-698e1d4aa35a]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:15 user nova-compute[75266]: INFO nova.compute.manager [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Detaching volume 50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:47:15 user nova-compute[75266]: INFO nova.virt.block_device [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Attempting to driver detach volume 50546c9b-1f14-449e-b7dd-a9376344f840 from mountpoint /dev/vdb
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Attempting to detach device vdb from instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:47:15 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:15 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:47:15 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:47:15 user nova-compute[75266]:   <serial>50546c9b-1f14-449e-b7dd-a9376344f840</serial>
Nov 28 00:47:15 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:47:15 user nova-compute[75266]: </disk>
Nov 28 00:47:15 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:15 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdb from instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a from the persistent domain config.
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:47:15 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:15 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:47:15 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:47:15 user nova-compute[75266]:   <serial>50546c9b-1f14-449e-b7dd-a9376344f840</serial>
Nov 28 00:47:15 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:47:15 user nova-compute[75266]: </disk>
Nov 28 00:47:15 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:15 user nova-compute[75266]: INFO nova.compute.manager [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Rescuing
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:47:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26262363061656566', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363061656566', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'flavor' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:47:16 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:16 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:47:16 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:47:16 user nova-compute[75266]:   <serial>5dcc4ca3-dba8-4e3f-b69a-2093ba519c05</serial>
Nov 28 00:47:16 user nova-compute[75266]: </disk>
Nov 28 00:47:16 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:16 user nova-compute[75266]: WARNING nova.compute.manager [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state active and task_state rescuing.
Nov 28 00:47:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:60:ee:42, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance destroyed successfully.
Nov 28 00:47:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Attempting a stable device rescue
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.501s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:47:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Creating image(s)
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 1.133s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG nova.virt.images [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 6c122d45-aa11-4336-b324-dd51aa4eda4e was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.part /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:19 user nova-compute[75266]: WARNING nova.compute.manager [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state active and task_state rescuing.
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: INFO nova.compute.manager [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Rebuilding instance
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.part /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.converted" returned: 0 in 0.770s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.291s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:19 user nova-compute[75266]: WARNING nova.compute.manager [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state active and task_state rebuilding.
Nov 28 00:47:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d,backing_fmt=raw /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d,backing_fmt=raw /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue" returned: 0 in 0.053s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "7b779762ea52d21917ae2ac7b70b26dfdfd6e79d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'migration_context' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.objects.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<92237bf8-8ea4-4f79-938d-6dfe03edd31d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start _get_guest_xml network_info=[{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:9f:c8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c122d45-aa11-4336-b324-dd51aa4eda4e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '92237bf8-8ea4-4f79-938d-6dfe03edd31d', 'attached_at': '', 'detached_at': '', 'volume_id': '04532fc5-654b-46d5-a1c4-32bbf6318974', 'serial': '04532fc5-654b-46d5-a1c4-32bbf6318974'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'adea6b4b-ecd1-44ff-b0b6-003a7b0ba401', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:47:19 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<92237bf8-8ea4-4f79-938d-6dfe03edd31d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'numa_topology' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<92237bf8-8ea4-4f79-938d-6dfe03edd31d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance destroyed successfully.
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<92237bf8-8ea4-4f79-938d-6dfe03edd31d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:20 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a73c2-9f97-4814-9c08-3fdcc8454dca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BpnRgKLY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 00:47:20 user nova-compute[75266]: node.name = iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:47:20 user nova-compute[75266]: node.tpgt = -1
Nov 28 00:47:20 user nova-compute[75266]: node.startup = automatic
Nov 28 00:47:20 user nova-compute[75266]: node.leading_login = No
Nov 28 00:47:20 user nova-compute[75266]: iface.iscsi_ifacename = default
Nov 28 00:47:20 user nova-compute[75266]: iface.net_ifacename = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.ipaddress = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.prefix_len = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.hwaddress = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.transport_name = tcp
Nov 28 00:47:20 user nova-compute[75266]: iface.initiatorname = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.vlan_id = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.vlan_priority = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.vlan_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.iface_num = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.mtu = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.port = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.bootproto = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.subnet_mask = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.gateway = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_alt_client_id = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_dns = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_learn_iqn = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_vendor_id_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_vendor_id = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.dhcp_slp_da = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.fragmentation = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.gratuitous_arp = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.incoming_forwarding = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.tos_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.tos = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.ttl = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.delayed_ack = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.tcp_nagle = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.tcp_wsf_state = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.tcp_wsf = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.tcp_timer_scale = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.tcp_timestamp = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.redirect = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.def_task_mgmt_timeout = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.header_digest = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.data_digest = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.immediate_data = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.initial_r2t = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.data_seq_inorder = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.data_pdu_inorder = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.erl = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.max_receive_data_len = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.first_burst_len = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.max_outstanding_r2t = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.max_burst_len = 0
Nov 28 00:47:20 user nova-compute[75266]: iface.chap_auth = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.bidi_chap = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.strict_login_compliance = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.discovery_auth = <empty>
Nov 28 00:47:20 user nova-compute[75266]: iface.discovery_logout = <empty>
Nov 28 00:47:20 user nova-compute[75266]: node.discovery_address = <empty>
Nov 28 00:47:20 user nova-compute[75266]: node.discovery_port = 0
Nov 28 00:47:20 user nova-compute[75266]: node.discovery_type = static
Nov 28 00:47:20 user nova-compute[75266]: node.session.initial_cmdsn = 0
Nov 28 00:47:20 user nova-compute[75266]: node.session.initial_login_retry_max = 8
Nov 28 00:47:20 user nova-compute[75266]: node.session.xmit_thread_priority = -20
Nov 28 00:47:20 user nova-compute[75266]: node.session.cmds_max = 128
Nov 28 00:47:20 user nova-compute[75266]: node.session.queue_depth = 32
Nov 28 00:47:20 user nova-compute[75266]: node.session.nr_sessions = 1
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.authmethod = CHAP
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.username = BpnRgKLY
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.password = ***
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.username_in = <empty>
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.password_in = <empty>
Nov 28 00:47:20 user nova-compute[75266]: node.session.auth.chap_algs = MD5
Nov 28 00:47:20 user nova-compute[75266]: node.session.timeo.replacement_timeout = 120
Nov 28 00:47:20 user nova-compute[75266]: node.session.err_timeo.abort_timeout = 15
Nov 28 00:47:20 user nova-compute[75266]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 00:47:20 user nova-compute[75266]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 00:47:20 user nova-compute[75266]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.FastAbort = Yes
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.InitialR2T = No
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.ImmediateData = Yes
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.MaxConnections = 1
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 00:47:20 user nova-compute[75266]: node.session.iscsi.ERL = 0
Nov 28 00:47:20 user nova-compute[75266]: node.session.scan = manual
Nov 28 00:47:20 user nova-compute[75266]: node.session.reopen_max = 0
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].address = 172.16.0.220
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].port = 3260
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].startup = manual
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].tcp.window_size = 524288
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].tcp.type_of_service = 0
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].timeo.logout_timeout = 15
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].timeo.login_timeout = 15
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].timeo.auth_timeout = 45
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.DataDigest = None
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.IFMarker = No
Nov 28 00:47:20 user nova-compute[75266]: node.conn[0].iscsi.OFMarker = No
Nov 28 00:47:20 user nova-compute[75266]: # END RECORD
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc56b9-8c58-4106-9a09-b7fbcad0426a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: INFO nova.compute.manager [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Detaching volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d53b300-d464-4d1e-ae76-acb1e040e981]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpnRgKLY {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpnRgKLY" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c90fa9-72e1-4275-ab28-d3ec24129060]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpnRgKLY'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a0671-a8dc-41dd-9797-bdbc191ee1f3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: INFO nova.virt.block_device [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attempting to driver detach volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 from mountpoint /dev/vdb
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c072fb-a77e-4e17-a6a4-aa6c717c6b61]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Attempting to detach device vdb from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:47:20 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:20 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:47:20 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:47:20 user nova-compute[75266]:   <serial>5dcc4ca3-dba8-4e3f-b69a-2093ba519c05</serial>
Nov 28 00:47:20 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:47:20 user nova-compute[75266]: </disk>
Nov 28 00:47:20 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd08e8d-5242-4f37-879d-8690de0418fc]: (4, ('0 0 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.227s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== connect_volume: return (229ms) {'type': 'block', 'scsi_wwn': '23162373431326531', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162373431326531', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully detached device vdb from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the persistent domain config.
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1413117774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1413117774',id=16,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-7fzl3ejn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:45:46Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=92237bf8-8ea4-4f79-938d-6dfe03edd31d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:9f:c8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:9f:c8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03367d-893d-4d18-9020-234ade40a576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:47:20 user nova-compute[75266]: No targets found.
Nov 28 00:47:20 user nova-compute[75266]: iSNS:
Nov 28 00:47:20 user nova-compute[75266]: No targets found.
Nov 28 00:47:20 user nova-compute[75266]: STATIC:
Nov 28 00:47:20 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:47:20 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:20 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:20 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:47:20 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:20 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:20 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:47:20 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:20 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:20 user nova-compute[75266]: FIRMWARE:
Nov 28 00:47:20 user nova-compute[75266]: No targets found.
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:47:20 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:47:20 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<92237bf8-8ea4-4f79-938d-6dfe03edd31d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:47:20 user nova-compute[75266]:   <uuid>92237bf8-8ea4-4f79-938d-6dfe03edd31d</uuid>
Nov 28 00:47:20 user nova-compute[75266]:   <name>instance-00000010</name>
Nov 28 00:47:20 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:47:20 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:47:20 user nova-compute[75266]:   <metadata>
Nov 28 00:47:20 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:47:20 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1413117774</nova:name>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:47:20</nova:creationTime>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:47:20 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:47:20 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:owner>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:47:20 user nova-compute[75266]:       </nova:owner>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:47:20 user nova-compute[75266]:       <nova:ports>
Nov 28 00:47:20 user nova-compute[75266]:         <nova:port uuid="d57d7084-7f1f-4e79-9770-0fe51e5f13fc">
Nov 28 00:47:20 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 00:47:20 user nova-compute[75266]:         </nova:port>
Nov 28 00:47:20 user nova-compute[75266]:       </nova:ports>
Nov 28 00:47:20 user nova-compute[75266]:     </nova:instance>
Nov 28 00:47:20 user nova-compute[75266]:   </metadata>
Nov 28 00:47:20 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:47:20 user nova-compute[75266]:     <system>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="serial">92237bf8-8ea4-4f79-938d-6dfe03edd31d</entry>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="uuid">92237bf8-8ea4-4f79-938d-6dfe03edd31d</entry>
Nov 28 00:47:20 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:47:20 user nova-compute[75266]:     </system>
Nov 28 00:47:20 user nova-compute[75266]:   </sysinfo>
Nov 28 00:47:20 user nova-compute[75266]:   <os>
Nov 28 00:47:20 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:47:20 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:47:20 user nova-compute[75266]:   </os>
Nov 28 00:47:20 user nova-compute[75266]:   <features>
Nov 28 00:47:20 user nova-compute[75266]:     <acpi/>
Nov 28 00:47:20 user nova-compute[75266]:     <apic/>
Nov 28 00:47:20 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:47:20 user nova-compute[75266]:   </features>
Nov 28 00:47:20 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:47:20 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:47:20 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:47:20 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:47:20 user nova-compute[75266]:   </clock>
Nov 28 00:47:20 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:47:20 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:47:20 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:47:20 user nova-compute[75266]:   </cpu>
Nov 28 00:47:20 user nova-compute[75266]:   <devices>
Nov 28 00:47:20 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:47:20 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:20 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 00:47:20 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:47:20 user nova-compute[75266]:       <serial>04532fc5-654b-46d5-a1c4-32bbf6318974</serial>
Nov 28 00:47:20 user nova-compute[75266]:     </disk>
Nov 28 00:47:20 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:47:20 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:47:20 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue"/>
Nov 28 00:47:20 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:47:20 user nova-compute[75266]:       <boot order="1"/>
Nov 28 00:47:20 user nova-compute[75266]:     </disk>
Nov 28 00:47:20 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:47:20 user nova-compute[75266]:       <mac address="fa:16:3e:9f:c8:ec"/>
Nov 28 00:47:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:20 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:47:20 user nova-compute[75266]:       <target dev="tapd57d7084-7f"/>
Nov 28 00:47:20 user nova-compute[75266]:     </interface>
Nov 28 00:47:20 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:47:20 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/console.log" append="off"/>
Nov 28 00:47:20 user nova-compute[75266]:     </serial>
Nov 28 00:47:20 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:47:20 user nova-compute[75266]:     <video>
Nov 28 00:47:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:20 user nova-compute[75266]:     </video>
Nov 28 00:47:20 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:47:20 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:47:20 user nova-compute[75266]:     </rng>
Nov 28 00:47:20 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:47:20 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:47:20 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:47:20 user nova-compute[75266]:     </memballoon>
Nov 28 00:47:20 user nova-compute[75266]:   </devices>
Nov 28 00:47:20 user nova-compute[75266]: </domain>
Nov 28 00:47:20 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b79f3-34ce-4dd0-a010-6171f9f2a9f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance destroyed successfully.
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d52ab6-51ce-455c-90ee-b18bcc3be300]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c457250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:9f:c8:ec, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57fbe45-9631-40f9-a202-7b8c3a44e826]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710482e-f839-403c-aa3c-0e1587dea3fb]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde49fdb-9a02-4922-b0fe-3810ae707ffd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e67326-88fe-429d-b81d-5415ace35c25]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8290604-d04e-4a3f-bb9b-fd863137129f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc7a1cd-1761-4d65-82ad-9ea08a7976ed]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]
Nov 28 00:47:20 user nova-compute[75266]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.
Nov 28 00:47:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c8929a-21b6-45ce-ba58-93f106a15f96]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== disconnect_volume: return (417ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance destroyed successfully.
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-ServerActionsTestOtherA-server-622494469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:21 user nova-compute[75266]: WARNING nova.compute.manager [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state active and task_state rebuilding.
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85cfd155-65, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bf7d505-4eaf-4e99-adb2-c182394bad37) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: INFO os_vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65')
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9928f792-05a8-4109-aafb-772b126bb529]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:47:21 user nova-compute[75266]: No targets found.
Nov 28 00:47:21 user nova-compute[75266]: iSNS:
Nov 28 00:47:21 user nova-compute[75266]: No targets found.
Nov 28 00:47:21 user nova-compute[75266]: STATIC:
Nov 28 00:47:21 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:47:21 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:21 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:21 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:47:21 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:21 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:21 user nova-compute[75266]: FIRMWARE:
Nov 28 00:47:21 user nova-compute[75266]: No targets found.
Nov 28 00:47:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:47:21 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:47:21 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5be83-c066-4b25-9136-e152b9d629fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b850e86-9af4-448e-b472-3c2aa7d2603c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:21 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:21 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c57ef80>, {}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Disconnecting from: [] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.132s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== disconnect_volume: return (134ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:47:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Deleting instance files /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08_del
Nov 28 00:47:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Deletion of /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08_del complete
Nov 28 00:47:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:22 user nova-compute[75266]: WARNING nova.compute.manager [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state active and task_state rescuing.
Nov 28 00:47:22 user nova-compute[75266]: INFO nova.virt.block_device [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Booting with volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 at /dev/vdb
Nov 28 00:47:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f87ffa-574f-4872-8706-498ae3d4624c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:24 user nova-compute[75266]: WARNING nova.compute.manager [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state active and task_state rescuing.
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7358MB free_disk=25.340534210205078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309e5b9-5136-4920-bdde-2d3f2bd3040a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e2bf15-2936-4ec6-9f06-c915a423675d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc517c-6206-4612-afb2-a0cff71e6376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:47:24 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:47:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f1c2a-6a77-4b4f-aef4-150a586f45d0]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG os_brick.utils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== get_connector_properties: return (1976ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating existing volume attachment record: 772cee02-2a59-4039-95e8-cacf15cdc3a9 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c8307b4a-ad04-4830-9752-5157af5a4f3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d1074b86-5b6a-4d85-a028-ae52d079467f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 00:47:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.060s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:47:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating instance_info_cache with network_info: [{"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-6f443cac-7a1c-49d2-9ed1-79a13883688a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:47:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:47:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:47:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Creating image(s)
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk 1073741824" returned: 0 in 0.061s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Cannot resize image /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Ensure instance console log exists: /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start _get_guest_xml network_info=[{"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ccbf5fa2-6207-49fd-9cca-127fb0358d08', 'attached_at': '', 'detached_at': '', 'volume_id': '5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'serial': '5dcc4ca3-dba8-4e3f-b69a-2093ba519c05'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '772cee02-2a59-4039-95e8-cacf15cdc3a9', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:47:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 00:47:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:32 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0837369-2fb1-4172-9d91-1d34b8939887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:47:32 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f3e03-79c5-47fd-ad33-e61c373e2740]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05] added
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172b9c7-8d63-4b00-9421-6c99365b5743]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdb5da7-5273-4319-b376-cfc6b094eb1c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqYiSZQT {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqYiSZQT" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a0024-4628-4ab5-955f-6f5ea5ad4bd4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqYiSZQT'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3464515-2b27-419b-9830-c5c4c4650cf1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc1aee2-4a49-44dc-b212-f0dc17b62d2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[193857f0-a9ac-4d12-a9bb-004144984598]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]
Nov 28 00:47:32 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb7783-87d9-4086-bbeb-1ceb3ee83a58]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506b99d-838e-4443-94ac-587c13d5e1f3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[485112cd-6369-4435-9f48-7074b17c92c1]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:47:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:47:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26262363061656566', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363061656566', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-ServerActionsTestOtherA-server-622494469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:47:34 user nova-compute[75266]:   <uuid>ccbf5fa2-6207-49fd-9cca-127fb0358d08</uuid>
Nov 28 00:47:34 user nova-compute[75266]:   <name>instance-0000000f</name>
Nov 28 00:47:34 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:47:34 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:47:34 user nova-compute[75266]:   <metadata>
Nov 28 00:47:34 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:47:34 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherA-server-622494469</nova:name>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:47:32</nova:creationTime>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:47:34 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:47:34 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:owner>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:user uuid="f63a0e9261934c8b8e673f069c3376bd">tempest-ServerActionsTestOtherA-277302336-project-member</nova:user>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:project uuid="22c31829ff0846fc8584d492bea6cdc4">tempest-ServerActionsTestOtherA-277302336</nova:project>
Nov 28 00:47:34 user nova-compute[75266]:       </nova:owner>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:47:34 user nova-compute[75266]:       <nova:ports>
Nov 28 00:47:34 user nova-compute[75266]:         <nova:port uuid="85cfd155-656c-4678-9381-9603640b1bd4">
Nov 28 00:47:34 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:47:34 user nova-compute[75266]:         </nova:port>
Nov 28 00:47:34 user nova-compute[75266]:       </nova:ports>
Nov 28 00:47:34 user nova-compute[75266]:     </nova:instance>
Nov 28 00:47:34 user nova-compute[75266]:   </metadata>
Nov 28 00:47:34 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:47:34 user nova-compute[75266]:     <system>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="serial">ccbf5fa2-6207-49fd-9cca-127fb0358d08</entry>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="uuid">ccbf5fa2-6207-49fd-9cca-127fb0358d08</entry>
Nov 28 00:47:34 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:47:34 user nova-compute[75266]:     </system>
Nov 28 00:47:34 user nova-compute[75266]:   </sysinfo>
Nov 28 00:47:34 user nova-compute[75266]:   <os>
Nov 28 00:47:34 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:47:34 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:47:34 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:47:34 user nova-compute[75266]:   </os>
Nov 28 00:47:34 user nova-compute[75266]:   <features>
Nov 28 00:47:34 user nova-compute[75266]:     <acpi/>
Nov 28 00:47:34 user nova-compute[75266]:     <apic/>
Nov 28 00:47:34 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:47:34 user nova-compute[75266]:   </features>
Nov 28 00:47:34 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:47:34 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:47:34 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:47:34 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:47:34 user nova-compute[75266]:   </clock>
Nov 28 00:47:34 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:47:34 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:47:34 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:47:34 user nova-compute[75266]:   </cpu>
Nov 28 00:47:34 user nova-compute[75266]:   <devices>
Nov 28 00:47:34 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:47:34 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:47:34 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk"/>
Nov 28 00:47:34 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:47:34 user nova-compute[75266]:     </disk>
Nov 28 00:47:34 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:47:34 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:47:34 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:47:34 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:47:34 user nova-compute[75266]:       <serial>5dcc4ca3-dba8-4e3f-b69a-2093ba519c05</serial>
Nov 28 00:47:34 user nova-compute[75266]:     </disk>
Nov 28 00:47:34 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:47:34 user nova-compute[75266]:       <mac address="fa:16:3e:60:ee:42"/>
Nov 28 00:47:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:34 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:47:34 user nova-compute[75266]:       <target dev="tap85cfd155-65"/>
Nov 28 00:47:34 user nova-compute[75266]:     </interface>
Nov 28 00:47:34 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:47:34 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/console.log" append="off"/>
Nov 28 00:47:34 user nova-compute[75266]:     </serial>
Nov 28 00:47:34 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:47:34 user nova-compute[75266]:     <video>
Nov 28 00:47:34 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:47:34 user nova-compute[75266]:     </video>
Nov 28 00:47:34 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:47:34 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:47:34 user nova-compute[75266]:     </rng>
Nov 28 00:47:34 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:47:34 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:47:34 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:47:34 user nova-compute[75266]:     </memballoon>
Nov 28 00:47:34 user nova-compute[75266]:   </devices>
Nov 28 00:47:34 user nova-compute[75266]: </domain>
Nov 28 00:47:34 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-ServerActionsTestOtherA-server-622494469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG os_vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0f07b59-ded9-5eba-897d-3725ccbd7ef5', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85cfd155-65, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85cfd155-65, col_values=(('qos', UUID('1d52837b-505a-4fd5-940d-ddf616a432e1')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85cfd155-65, col_values=(('external_ids', {'iface-id': '85cfd155-656c-4678-9381-9603640b1bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ee:42', 'vm-uuid': 'ccbf5fa2-6207-49fd-9cca-127fb0358d08'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:34 user nova-compute[75266]: INFO os_vif [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65')
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:47:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:60:ee:42, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:35 user nova-compute[75266]: WARNING nova.compute.manager [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:36 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a is timed out.
Nov 28 00:47:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdb from instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a from the live domain config.
Nov 28 00:47:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKMiafcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:47:36 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac33d66-3c2e-4c77-87fc-62af8fd86222]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:47:36 user nova-compute[75266]: No targets found.
Nov 28 00:47:36 user nova-compute[75266]: iSNS:
Nov 28 00:47:36 user nova-compute[75266]: No targets found.
Nov 28 00:47:36 user nova-compute[75266]: STATIC:
Nov 28 00:47:36 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840
Nov 28 00:47:36 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:36 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:36 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:47:36 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:36 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:36 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:47:36 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:47:36 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:47:36 user nova-compute[75266]: FIRMWARE:
Nov 28 00:47:36 user nova-compute[75266]: No targets found.
Nov 28 00:47:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:47:36 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:47:36 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dde7ea-1512-4680-8935-83ab7e93a9e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc640f-db3c-4a21-a2be-3f4946905753]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:47:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c33b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85eba49-94e1-4114-b0a1-d3cb720211d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8afd7-8adc-4f79-9099-86fbee430a60]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b5995-09c1-4eb9-a213-341726becda8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[61040c49-01d4-48cd-8972-1c42b116fc87]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a181f5c-b4cf-419a-a42e-abddc1ed3fd4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9f157-b668-4d85-ae6d-fe498992ffc0]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260]
Nov 28 00:47:36 user nova-compute[75266]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840, portal: 172.16.0.220,3260] successful.
Nov 28 00:47:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50546c9b-1f14-449e-b7dd-a9376344f840 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4530a6-2c91-4d14-a496-45d3b5844fc4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== disconnect_volume: return (317ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:36 user nova-compute[75266]: INFO nova.compute.manager [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Terminating instance
Nov 28 00:47:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-unplugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] No waiting events found dispatching network-vif-unplugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-unplugged-7b8ba726-9082-4459-86ba-f4317c342dbe for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Instance destroyed successfully.
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'resources' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1834749863',display_name='tempest-VolumesAdminNegativeTest-server-1834749863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1834749863',id=6,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmhSe4yt2zgpFuLSEaBNMFCfQEO+QSmraG+pYRtdpblrmCGO6mV7MPaD+lQDdSMsHI6o6aUzPYUDsWwGXKodtKN0zw3FGkAKn1th/bUwX4t22USh80iUUJSHJ67JruAZA==',key_name='tempest-keypair-2094337696',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea1afcbb4b3643c5ae366c8e39f3d8ed',ramdisk_id='',reservation_id='r-9t0lpu0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-119723273',owner_user_name='tempest-VolumesAdminNegativeTest-119723273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6657488fa71b469c954276af7717308e',uuid=6f443cac-7a1c-49d2-9ed1-79a13883688a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converting VIF {"id": "7b8ba726-9082-4459-86ba-f4317c342dbe", "address": "fa:16:3e:03:99:69", "network": {"id": "5e24bcbb-fe85-4019-a107-ea0b5809297e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1086187293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea1afcbb4b3643c5ae366c8e39f3d8ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ba726-90", "ovs_interfaceid": "7b8ba726-9082-4459-86ba-f4317c342dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG os_vif [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b8ba726-90, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74d794f3-c5ff-4b1e-9ffd-91734bf2c6e9) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:37 user nova-compute[75266]: INFO os_vif [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:99:69,bridge_name='br-int',has_traffic_filtering=True,id=7b8ba726-9082-4459-86ba-f4317c342dbe,network=Network(5e24bcbb-fe85-4019-a107-ea0b5809297e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b8ba726-90')
Nov 28 00:47:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Deleting instance files /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a_del
Nov 28 00:47:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Deletion of /opt/stack/data/nova/instances/6f443cac-7a1c-49d2-9ed1-79a13883688a_del complete
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:47:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance spawned successfully.
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:37 user nova-compute[75266]: WARNING nova.compute.manager [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:47:37 user nova-compute[75266]: INFO nova.compute.manager [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75266) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75266) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG nova.objects.instance [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:38 user nova-compute[75266]: WARNING nova.compute.manager [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state active and task_state powering-off.
Nov 28 00:47:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:47:39 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Took 1.29 seconds to deallocate network for instance.
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance destroyed successfully.
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.917s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Acquiring lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] No waiting events found dispatching network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:39 user nova-compute[75266]: WARNING nova.compute.manager [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received unexpected event network-vif-plugged-7b8ba726-9082-4459-86ba-f4317c342dbe for instance with vm_state deleted and task_state None.
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Received event network-vif-deleted-7b8ba726-9082-4459-86ba-f4317c342dbe {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:39 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Deleted allocations for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a
Nov 28 00:47:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "6f443cac-7a1c-49d2-9ed1-79a13883688a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.748s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:47:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:47:40 user nova-compute[75266]: WARNING nova.compute.manager [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state None.
Nov 28 00:47:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:47:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:02 user nova-compute[75266]: INFO nova.compute.manager [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Unrescuing
Nov 28 00:48:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:48:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:48:02 user nova-compute[75266]: DEBUG nova.network.neutron [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:48:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:03 user nova-compute[75266]: WARNING nova.compute.manager [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:48:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance destroyed successfully.
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:05 user nova-compute[75266]: WARNING nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:48:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:05 user nova-compute[75266]: WARNING nova.compute.manager [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lazy-loading 'flavor' on Instance uuid c8307b4a-ad04-4830-9752-5157af5a4f3b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:06 user nova-compute[75266]: INFO nova.compute.manager [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Attaching volume 9c5fa0eb-8c36-48e7-aa93-3034798b5293 to /dev/vdb
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.utils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adee3f2-fd55-452c-a6f6-317fd86ebaf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa074d-adc9-4829-9b92-fc80342d6f4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8243637e-a8ca-4602-bb29-a15e5af6c552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a92266-baa0-499c-ab3a-b7e173093edd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:06 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:48:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5ee493-8590-4aad-b483-874d18b4516b]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG os_brick.utils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:06 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updating existing volume attachment record: d3e1bea4-502a-448a-9763-b3fc976fa2e8 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:07 user nova-compute[75266]: WARNING nova.compute.manager [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state active and task_state None.
Nov 28 00:48:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 55113bea-793b-4d9f-a897-f6f7eb261079 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 19151248-a33d-46b2-be99-0a85a5ab88d3 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid c8307b4a-ad04-4830-9752-5157af5a4f3b {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid d1074b86-5b6a-4d85-a028-ae52d079467f {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "41828b32-f570-4428-8064-5c199a898a04" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "41828b32-f570-4428-8064-5c199a898a04" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKnFjzmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:13 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53aed4-06bb-4667-af47-bc165c44aab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:48:13 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6c83b3-8e1a-4e67-8813-a7834d560e3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293] added
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27229b2-ad68-43fa-8620-e7166cd43ec1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de4a07-3b8f-4a92-aee1-da0743d4084d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKnFjzmw {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKnFjzmw" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a62523-7e9a-436b-b160-147d50825aed]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKnFjzmw'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d60910-d1ee-4341-aa50-aa4979fba37f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7200a3-8765-415e-8a6c-909513a90acd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[538179ad-def0-408f-a0d8-10e2d19c47fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260]
Nov 28 00:48:13 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260] successful.
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87d300-fced-457d-b819-f3b1471d8f8d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d56c57-df0e-49f7-9528-70f84fea3890]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)
Nov 28 00:48:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07921a2-9900-48af-8894-206b25dba7bb]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:48:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKnFjzmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26565353962383339', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565353962383339', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lazy-loading 'flavor' on Instance uuid c8307b4a-ad04-4830-9752-5157af5a4f3b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:48:14 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:48:14 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:48:14 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:48:14 user nova-compute[75266]:   <serial>9c5fa0eb-8c36-48e7-aa93-3034798b5293</serial>
Nov 28 00:48:14 user nova-compute[75266]: </disk>
Nov 28 00:48:14 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] No VIF found with MAC fa:16:3e:f5:d5:9c, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.170s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.716s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:16 user nova-compute[75266]: INFO nova.compute.manager [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Terminating instance
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-unplugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] No waiting events found dispatching network-vif-unplugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-unplugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Instance destroyed successfully.
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lazy-loading 'resources' on Instance uuid c8307b4a-ad04-4830-9752-5157af5a4f3b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-164256632',display_name='tempest-DeleteServersTestJSON-server-164256632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-164256632',id=17,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e19068366934d7db3a2cb3131af5498',ramdisk_id='',reservation_id='r-refa2hah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1600931395',owner_user_name='tempest-DeleteServersTestJSON-1600931395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:46:22Z,user_data=None,user_id='b8dd53f8dd874658a31a1aaf40a4091e',uuid=c8307b4a-ad04-4830-9752-5157af5a4f3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converting VIF {"id": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "address": "fa:16:3e:f5:d5:9c", "network": {"id": "f7c0059b-8a32-43e9-8aee-01936933e250", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1064860448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e19068366934d7db3a2cb3131af5498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f0240f-a1", "ovs_interfaceid": "79f0240f-a11e-4733-adaa-4a5f4b2ae450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG os_vif [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79f0240f-a1, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=436da3a0-71d1-48ba-9cfb-2e86d2350e11) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:17 user nova-compute[75266]: INFO os_vif [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d5:9c,bridge_name='br-int',has_traffic_filtering=True,id=79f0240f-a11e-4733-adaa-4a5f4b2ae450,network=Network(f7c0059b-8a32-43e9-8aee-01936933e250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f0240f-a1')
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKnFjzmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:17 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5640e-9982-412a-9f9b-55b86e8a8efa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:48:17 user nova-compute[75266]: No targets found.
Nov 28 00:48:17 user nova-compute[75266]: iSNS:
Nov 28 00:48:17 user nova-compute[75266]: No targets found.
Nov 28 00:48:17 user nova-compute[75266]: STATIC:
Nov 28 00:48:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293
Nov 28 00:48:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:48:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:48:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:48:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:48:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:48:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:48:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:48:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:48:17 user nova-compute[75266]: FIRMWARE:
Nov 28 00:48:17 user nova-compute[75266]: No targets found.
Nov 28 00:48:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:48:17 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:48:17 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8030e-cf6c-4b73-9198-2de3f38d8f11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efdde0-25ff-43c1-a981-87495093c659]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 (non-flash)
Nov 28 00:48:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bad9ed900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ec5c1-6bd9-4c4c-a831-3a2b84c27f2b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5124e-b3be-412d-924c-4064c7685a02]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b6578-d43e-4a21-b35c-23420918f67f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe41100-700c-41c5-b82b-f5c02aa3cdaf]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4242ad0d-9b44-43c4-b486-86b44bc91378]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f2f38e-8905-4db6-a0e6-2e66812cc919]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260]
Nov 28 00:48:17 user nova-compute[75266]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293, portal: 172.16.0.220,3260] successful.
Nov 28 00:48:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c5fa0eb-8c36-48e7-aa93-3034798b5293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62880230-7a08-4870-8611-760ff84b2997]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] <== disconnect_volume: return (345ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:48:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Deleting instance files /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b_del
Nov 28 00:48:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Deletion of /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b_del complete
Nov 28 00:48:17 user nova-compute[75266]: INFO nova.compute.manager [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json" returned: 1 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk --force-share --output=json' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:17 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000011, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c8307b4a-ad04-4830-9752-5157af5a4f3b/disk
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-deleted-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:17 user nova-compute[75266]: INFO nova.compute.manager [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Neutron deleted interface 79f0240f-a11e-4733-adaa-4a5f4b2ae450; detaching it from the instance and deleting it from the info cache
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:17 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Took 0.49 seconds to deallocate network for instance.
Nov 28 00:48:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Detach interface failed, port_id=79f0240f-a11e-4733-adaa-4a5f4b2ae450, reason: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Acquiring lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] No waiting events found dispatching network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:18 user nova-compute[75266]: WARNING nova.compute.manager [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Received unexpected event network-vif-plugged-79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance with vm_state active and task_state deleting.
Nov 28 00:48:18 user nova-compute[75266]: INFO nova.compute.manager [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Took 0.80 seconds to detach 1 volumes for instance.
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:19 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Deleted allocations for instance c8307b4a-ad04-4830-9752-5157af5a4f3b
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "c8307b4a-ad04-4830-9752-5157af5a4f3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.388s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:48:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:22 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:48:22 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7493MB free_disk=25.222209930419922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d1074b86-5b6a-4d85-a028-ae52d079467f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:48:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:48:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-changed-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Refreshing instance network info cache due to event network-changed-9c1755ff-555e-44fa-8082-fceddb0ee343. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Refreshing network info cache for port 9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updated VIF entry in instance network info cache for port 9c1755ff-555e-44fa-8082-fceddb0ee343. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-changed-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Refreshing instance network info cache due to event network-changed-65e249eb-8337-4f50-b643-927be5058f5e. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Acquiring lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Acquired lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:48:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Refreshing network info cache for port 65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:48:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updated VIF entry in instance network info cache for port 65e249eb-8337-4f50-b643-927be5058f5e. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:48:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating instance_info_cache with network_info: [{"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Releasing lock "refresh_cache-0fc5430b-5c2a-4074-886e-d53482cb2bb9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:48:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:46 user nova-compute[75266]: INFO nova.compute.manager [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attaching volume aecabef3-171f-44b5-9f03-cb693bb7ca04 to /dev/vdb
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.utils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c47bdd-ba7f-493f-ba71-4e8b4a5037bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de93ba-34f3-4a8e-be09-7be0f5005a0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a94c4-6541-4aba-94cd-5c989b1f0c2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c09b5d8-0a9f-4b0c-872d-0c18252306c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:46 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:48:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9163307-b009-4d89-a94a-e6a6f67f1a0f]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG os_brick.utils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:46 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating existing volume attachment record: bca2ef95-e4da-420d-87ed-b41414f6e5ac {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:48:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:48:49 user nova-compute[75266]: INFO nova.compute.claims [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Claim successful on node user
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:48:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG nova.policy [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:48:49 user nova-compute[75266]: INFO nova.virt.block_device [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Booting with volume c2b4dff1-92b2-4410-a861-a1efbadb6787 at /dev/vda
Nov 28 00:48:49 user nova-compute[75266]: DEBUG os_brick.utils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a160380-226f-49d4-b564-36f8720eb679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c1a44-9331-41de-82e1-10c61b337a61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8801d07-1057-4793-91eb-23a3160e8e1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029ae88-8160-43e9-8aec-6790f17f75eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:48:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:48:50 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:48:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca94c40b-cbed-4880-b7bf-9c3236553ce8]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG os_brick.utils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating existing volume attachment record: 33f9b618-0787-4574-a362-01bc3cddb48e {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Successfully created port: 2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:48:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Successfully updated port: 2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquired lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-changed-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Refreshing instance network info cache due to event network-changed-2d3f6903-a024-4928-afba-ce8273784c3e. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Acquiring lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating instance_info_cache with network_info: [{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Releasing lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance network_info: |[{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Acquired lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Refreshing network info cache for port 2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updated VIF entry in instance network info cache for port 2d3f6903-a024-4928-afba-ce8273784c3e. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating instance_info_cache with network_info: [{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Releasing lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:48:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUFwdIRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:53 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:53 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:53 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f892901f-c25f-481d-a3ce-b1164bd385cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:48:53 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06363472-1ed5-41c4-9db0-6e681dc50271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04] added
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323251b-565d-4d89-bc1c-ceb305304360]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81228c83-c4e6-4229-bf72-3ef31d223275]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUFwdIRC {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUFwdIRC" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[69de74fe-1221-47f0-9936-88845fc1f2ab]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUFwdIRC'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d05003-9727-4f7d-a880-b4c9335b2d90]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f124084-de09-44c0-8beb-d96368751d68]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0305631f-efe0-42eb-bc8f-2680e45c2852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260]
Nov 28 00:48:53 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260] successful.
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[144188b0-1451-482c-803e-aeea46016cdc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5c8e0-232d-4807-bc21-d101a0e9665f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[36551e2c-6726-4a46-8916-1443f5fd85ee]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUFwdIRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23266363538616338', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266363538616338', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:48:54 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:48:54 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:48:54 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:48:54 user nova-compute[75266]:   <serial>aecabef3-171f-44b5-9f03-cb693bb7ca04</serial>
Nov 28 00:48:54 user nova-compute[75266]: </disk>
Nov 28 00:48:54 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:48:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:48:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:48:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No VIF found with MAC fa:16:3e:d1:c0:61, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:48:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.922s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.compute.manager [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Terminating instance
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-unplugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] No waiting events found dispatching network-vif-unplugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-unplugged-9a83bf89-f8f9-4fc2-9097-829795f361cd for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Creating image(s)
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Ensure instance console log exists: /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start _get_guest_xml network_info=[{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72e2c36d-6ae4-4af8-8511-5d36532b76e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2b4dff1-92b2-4410-a861-a1efbadb6787', 'serial': 'c2b4dff1-92b2-4410-a861-a1efbadb6787'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '33f9b618-0787-4574-a362-01bc3cddb48e', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Instance destroyed successfully.
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.objects.instance [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lazy-loading 'resources' on Instance uuid d1074b86-5b6a-4d85-a028-ae52d079467f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:57 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:48:57 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:48:57 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:57 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:48:57 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1991590042',display_name='tempest-VolumesActionsTest-instance-1991590042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1991590042',id=20,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-apj4iq0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:47:09Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=d1074b86-5b6a-4d85-a028-ae52d079467f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "address": "fa:16:3e:41:61:0f", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a83bf89-f8", "ovs_interfaceid": "9a83bf89-f8f9-4fc2-9097-829795f361cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_vif [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a83bf89-f8, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47ad0851-4fbb-4fdb-9b3b-9c11ff30025a) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[225fc76a-db51-4193-81a8-527c2c1dd0a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:48:57 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:57 user nova-compute[75266]: INFO os_vif [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:61:0f,bridge_name='br-int',has_traffic_filtering=True,id=9a83bf89-f8f9-4fc2-9097-829795f361cd,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a83bf89-f8')
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Deleting instance files /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f_del
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Deletion of /opt/stack/data/nova/instances/d1074b86-5b6a-4d85-a028-ae52d079467f_del complete
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229f735-cdb9-4f2c-852d-92c60f875e5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787] added
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[54320977-0f95-4fa5-ab82-456c829cd890]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca1ae89-133d-4769-9fdd-71fad55dec25]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySbBoxIA {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: INFO nova.compute.manager [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySbBoxIA" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf7fc9-4f2f-478f-a8f9-3f1d917b25db]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySbBoxIA'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c6ae0-c578-4f4d-b105-4b5ab9cf9494]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee6a59-c1f0-4d14-a9cd-5bdeb03889c8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9cc51c-be37-43b1-abc6-5414e467f746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]
Nov 28 00:48:57 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d033e-5e2e-4c46-8cf4-3cbc4239d26f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0997e-9225-4b4a-ad09-2b995ce62f2b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:48:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[78df069a-7a02-49af-8388-f7aed3f5b92a]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:48:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:58 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Took 0.41 seconds to deallocate network for instance.
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-deleted-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:58 user nova-compute[75266]: INFO nova.compute.manager [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Neutron deleted interface 9a83bf89-f8f9-4fc2-9097-829795f361cd; detaching it from the instance and deleting it from the info cache
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Detach interface failed, port_id=9a83bf89-f8f9-4fc2-9097-829795f361cd, reason: Instance d1074b86-5b6a-4d85-a028-ae52d079467f could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:58 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Deleted allocations for instance d1074b86-5b6a-4d85-a028-ae52d079467f
Nov 28 00:48:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23365666132303539', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:48:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365666132303539', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948315245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lazy-loading 'pci_devices' on Instance uuid 72e2c36d-6ae4-4af8-8511-5d36532b76e0 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:48:59 user nova-compute[75266]:   <uuid>72e2c36d-6ae4-4af8-8511-5d36532b76e0</uuid>
Nov 28 00:48:59 user nova-compute[75266]:   <name>instance-00000015</name>
Nov 28 00:48:59 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:48:59 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:48:59 user nova-compute[75266]:   <metadata>
Nov 28 00:48:59 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:48:59 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:48:59 user nova-compute[75266]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1948315245</nova:name>
Nov 28 00:48:59 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:48:57</nova:creationTime>
Nov 28 00:48:59 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:48:59 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:48:59 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:48:59 user nova-compute[75266]:       <nova:owner>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:user uuid="9549789f88df42959b0e1ecce3619f8b">tempest-ServerActionsV293TestJSON-1839048538-project-member</nova:user>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:project uuid="4ea5483b85d845699f0431b1cf8f6c7f">tempest-ServerActionsV293TestJSON-1839048538</nova:project>
Nov 28 00:48:59 user nova-compute[75266]:       </nova:owner>
Nov 28 00:48:59 user nova-compute[75266]:       <nova:ports>
Nov 28 00:48:59 user nova-compute[75266]:         <nova:port uuid="2d3f6903-a024-4928-afba-ce8273784c3e">
Nov 28 00:48:59 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 00:48:59 user nova-compute[75266]:         </nova:port>
Nov 28 00:48:59 user nova-compute[75266]:       </nova:ports>
Nov 28 00:48:59 user nova-compute[75266]:     </nova:instance>
Nov 28 00:48:59 user nova-compute[75266]:   </metadata>
Nov 28 00:48:59 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:48:59 user nova-compute[75266]:     <system>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="serial">72e2c36d-6ae4-4af8-8511-5d36532b76e0</entry>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="uuid">72e2c36d-6ae4-4af8-8511-5d36532b76e0</entry>
Nov 28 00:48:59 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:48:59 user nova-compute[75266]:     </system>
Nov 28 00:48:59 user nova-compute[75266]:   </sysinfo>
Nov 28 00:48:59 user nova-compute[75266]:   <os>
Nov 28 00:48:59 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:48:59 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:48:59 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:48:59 user nova-compute[75266]:   </os>
Nov 28 00:48:59 user nova-compute[75266]:   <features>
Nov 28 00:48:59 user nova-compute[75266]:     <acpi/>
Nov 28 00:48:59 user nova-compute[75266]:     <apic/>
Nov 28 00:48:59 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:48:59 user nova-compute[75266]:   </features>
Nov 28 00:48:59 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:48:59 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:48:59 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:48:59 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:48:59 user nova-compute[75266]:   </clock>
Nov 28 00:48:59 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:48:59 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:48:59 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:48:59 user nova-compute[75266]:   </cpu>
Nov 28 00:48:59 user nova-compute[75266]:   <devices>
Nov 28 00:48:59 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:48:59 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:48:59 user nova-compute[75266]:       <source dev="/dev/sde"/>
Nov 28 00:48:59 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:48:59 user nova-compute[75266]:       <serial>c2b4dff1-92b2-4410-a861-a1efbadb6787</serial>
Nov 28 00:48:59 user nova-compute[75266]:     </disk>
Nov 28 00:48:59 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:48:59 user nova-compute[75266]:       <mac address="fa:16:3e:bd:91:a4"/>
Nov 28 00:48:59 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:48:59 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:48:59 user nova-compute[75266]:       <target dev="tap2d3f6903-a0"/>
Nov 28 00:48:59 user nova-compute[75266]:     </interface>
Nov 28 00:48:59 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:48:59 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0/console.log" append="off"/>
Nov 28 00:48:59 user nova-compute[75266]:     </serial>
Nov 28 00:48:59 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:48:59 user nova-compute[75266]:     <video>
Nov 28 00:48:59 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:48:59 user nova-compute[75266]:     </video>
Nov 28 00:48:59 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:48:59 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:48:59 user nova-compute[75266]:     </rng>
Nov 28 00:48:59 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:48:59 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:48:59 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:48:59 user nova-compute[75266]:     </memballoon>
Nov 28 00:48:59 user nova-compute[75266]:   </devices>
Nov 28 00:48:59 user nova-compute[75266]: </domain>
Nov 28 00:48:59 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948315245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG os_vif [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9e3b97a-c132-5b95-bbae-1f0a8e0a1824', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3f6903-a0, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d3f6903-a0, col_values=(('qos', UUID('9b31bae9-6bbc-4a0e-a3bc-4ec92b44c4ef')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d3f6903-a0, col_values=(('external_ids', {'iface-id': '2d3f6903-a024-4928-afba-ce8273784c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:91:a4', 'vm-uuid': '72e2c36d-6ae4-4af8-8511-5d36532b76e0'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:48:59 user nova-compute[75266]: INFO os_vif [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0')
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] No VIF found with MAC fa:16:3e:bd:91:a4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Acquiring lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Lock "d1074b86-5b6a-4d85-a028-ae52d079467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:48:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] No waiting events found dispatching network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:48:59 user nova-compute[75266]: WARNING nova.compute.manager [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Received unexpected event network-vif-plugged-9a83bf89-f8f9-4fc2-9097-829795f361cd for instance with vm_state deleted and task_state None.
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:00 user nova-compute[75266]: WARNING nova.compute.manager [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state building and task_state spawning.
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:49:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance spawned successfully.
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:02 user nova-compute[75266]: WARNING nova.compute.manager [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state building and task_state spawning.
Nov 28 00:49:02 user nova-compute[75266]: INFO nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 28 00:49:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:49:02 user nova-compute[75266]: INFO nova.compute.manager [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Took 13.57 seconds to build instance.
Nov 28 00:49:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.673s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:06 user nova-compute[75266]: INFO nova.compute.manager [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Unrescuing
Nov 28 00:49:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'flavor' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:07 user nova-compute[75266]: WARNING nova.compute.manager [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:49:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance destroyed successfully.
Nov 28 00:49:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:08 user nova-compute[75266]: INFO nova.compute.manager [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Detaching volume aecabef3-171f-44b5-9f03-cb693bb7ca04
Nov 28 00:49:08 user nova-compute[75266]: INFO nova.virt.block_device [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attempting to driver detach volume aecabef3-171f-44b5-9f03-cb693bb7ca04 from mountpoint /dev/vdb
Nov 28 00:49:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Attempting to detach device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:49:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:49:08 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:49:08 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:49:08 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:49:08 user nova-compute[75266]:   <serial>aecabef3-171f-44b5-9f03-cb693bb7ca04</serial>
Nov 28 00:49:08 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:49:08 user nova-compute[75266]: </disk>
Nov 28 00:49:08 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:49:08 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config.
Nov 28 00:49:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:49:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:49:08 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:49:08 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:49:08 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:49:08 user nova-compute[75266]:   <serial>aecabef3-171f-44b5-9f03-cb693bb7ca04</serial>
Nov 28 00:49:08 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:49:08 user nova-compute[75266]: </disk>
Nov 28 00:49:08 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:09 user nova-compute[75266]: WARNING nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:49:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:09 user nova-compute[75266]: WARNING nova.compute.manager [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:49:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:11 user nova-compute[75266]: WARNING nova.compute.manager [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:49:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:49:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:16 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:49:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:49:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:49:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.266368865966797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:49:21 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:49:22 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:49:22 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:49:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:49:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:49:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquired lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'info_cache' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:29 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 is timed out.
Nov 28 00:49:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config.
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUFwdIRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:49:29 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73040357-5b66-4f4f-83cf-cea65d934d55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:49:29 user nova-compute[75266]: No targets found.
Nov 28 00:49:29 user nova-compute[75266]: iSNS:
Nov 28 00:49:29 user nova-compute[75266]: No targets found.
Nov 28 00:49:29 user nova-compute[75266]: STATIC:
Nov 28 00:49:29 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04
Nov 28 00:49:29 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:49:29 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:49:29 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:49:29 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:49:29 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:49:29 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:49:29 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:49:29 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:49:29 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:49:29 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:49:29 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:49:29 user nova-compute[75266]: FIRMWARE:
Nov 28 00:49:29 user nova-compute[75266]: No targets found.
Nov 28 00:49:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:49:29 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:49:29 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71adfa-e066-46e5-bb0a-b46b39686d17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c729461-7ecc-4053-90d6-8dbb5413a259]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:49:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c6eef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b14b6-b591-4664-bd89-d2d2654d6299]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d711a3b2-22ac-45a4-8807-0db9f2031896]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9852e-c70b-4d17-adbe-bb94955bd3db]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[334147f2-842b-408e-a749-426397ff8797]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abab64f-1a95-4505-9623-4794d25c45d5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Releasing lock "refresh_cache-6f7c5378-aadc-45e4-b3c3-d308e526b03a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance destroyed successfully.
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'resources' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[795541c1-a14a-4ed9-ba28-1bee7502e41d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260]
Nov 28 00:49:29 user nova-compute[75266]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04, portal: 172.16.0.220,3260] successful.
Nov 28 00:49:29 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598b9806-e5, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=161c54a9-89e7-4edf-94f6-fc67defe6a03) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:29 user nova-compute[75266]: INFO os_vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start _get_guest_xml network_info=[{"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecabef3-171f-44b5-9f03-cb693bb7ca04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c265b43-6a0d-4cf0-b9ae-61f133149436]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== disconnect_volume: return (338ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:29 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:29 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:49:29 user nova-compute[75266]:   <uuid>6f7c5378-aadc-45e4-b3c3-d308e526b03a</uuid>
Nov 28 00:49:29 user nova-compute[75266]:   <name>instance-00000001</name>
Nov 28 00:49:29 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:49:29 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:49:29 user nova-compute[75266]:   <metadata>
Nov 28 00:49:29 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:49:29 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeTestJSON-server-1318610697</nova:name>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:49:29</nova:creationTime>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:49:29 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:49:29 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:owner>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:user uuid="7cf2b106f48442cd84784a5880737464">tempest-AttachVolumeTestJSON-1794071981-project-member</nova:user>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:project uuid="7cf38cc0048d41bfb69a50d55f9c1963">tempest-AttachVolumeTestJSON-1794071981</nova:project>
Nov 28 00:49:29 user nova-compute[75266]:       </nova:owner>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:49:29 user nova-compute[75266]:       <nova:ports>
Nov 28 00:49:29 user nova-compute[75266]:         <nova:port uuid="598b9806-e561-4d8b-9e33-1e8ec1268b48">
Nov 28 00:49:29 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:49:29 user nova-compute[75266]:         </nova:port>
Nov 28 00:49:29 user nova-compute[75266]:       </nova:ports>
Nov 28 00:49:29 user nova-compute[75266]:     </nova:instance>
Nov 28 00:49:29 user nova-compute[75266]:   </metadata>
Nov 28 00:49:29 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:49:29 user nova-compute[75266]:     <system>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="serial">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="uuid">6f7c5378-aadc-45e4-b3c3-d308e526b03a</entry>
Nov 28 00:49:29 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:49:29 user nova-compute[75266]:     </system>
Nov 28 00:49:29 user nova-compute[75266]:   </sysinfo>
Nov 28 00:49:29 user nova-compute[75266]:   <os>
Nov 28 00:49:29 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:49:29 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:49:29 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:49:29 user nova-compute[75266]:   </os>
Nov 28 00:49:29 user nova-compute[75266]:   <features>
Nov 28 00:49:29 user nova-compute[75266]:     <acpi/>
Nov 28 00:49:29 user nova-compute[75266]:     <apic/>
Nov 28 00:49:29 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:49:29 user nova-compute[75266]:   </features>
Nov 28 00:49:29 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:49:29 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:49:29 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:49:29 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:49:29 user nova-compute[75266]:   </clock>
Nov 28 00:49:29 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:49:29 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:49:29 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:49:29 user nova-compute[75266]:   </cpu>
Nov 28 00:49:29 user nova-compute[75266]:   <devices>
Nov 28 00:49:29 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:49:29 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:49:29 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk"/>
Nov 28 00:49:29 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:49:29 user nova-compute[75266]:     </disk>
Nov 28 00:49:29 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:49:29 user nova-compute[75266]:       <mac address="fa:16:3e:6b:f5:56"/>
Nov 28 00:49:29 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:49:29 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:49:29 user nova-compute[75266]:       <target dev="tap598b9806-e5"/>
Nov 28 00:49:29 user nova-compute[75266]:     </interface>
Nov 28 00:49:29 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:49:29 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/console.log" append="off"/>
Nov 28 00:49:29 user nova-compute[75266]:     </serial>
Nov 28 00:49:29 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:49:29 user nova-compute[75266]:     <video>
Nov 28 00:49:29 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:49:29 user nova-compute[75266]:     </video>
Nov 28 00:49:29 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:49:29 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:49:29 user nova-compute[75266]:     </rng>
Nov 28 00:49:29 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:49:29 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:49:29 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:49:29 user nova-compute[75266]:     </memballoon>
Nov 28 00:49:29 user nova-compute[75266]:   </devices>
Nov 28 00:49:29 user nova-compute[75266]: </domain>
Nov 28 00:49:29 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:49:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'migration_context' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.objects.base [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Object Instance<6f7c5378-aadc-45e4-b3c3-d308e526b03a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG os_vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b266ed-4f88-5a41-82d7-d5e0d9261db0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598b9806-e5, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap598b9806-e5, col_values=(('qos', UUID('6aa2d48f-5c01-4edf-bfda-cd9c97790003')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap598b9806-e5, col_values=(('external_ids', {'iface-id': '598b9806-e561-4d8b-9e33-1e8ec1268b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:f5:56', 'vm-uuid': '6f7c5378-aadc-45e4-b3c3-d308e526b03a'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:30 user nova-compute[75266]: INFO os_vif [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:49:30 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.042s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:32 user nova-compute[75266]: WARNING nova.compute.manager [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state powering-on.
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:49:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance rebooted successfully.
Nov 28 00:49:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:34 user nova-compute[75266]: WARNING nova.compute.manager [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state stopped and task_state powering-on.
Nov 28 00:49:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:49:43 user nova-compute[75266]: INFO nova.compute.claims [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Claim successful on node user
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:49:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:49:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:49:44 user nova-compute[75266]: INFO nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Booting with volume a6937f5b-e643-48c5-9a70-2ff88d4e5f2d at /dev/vda
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG nova.policy [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbaf550-68f9-47c1-a95d-a0b3073ecc92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc100e6-2df6-4614-9455-f30e7b4d2098]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8304614-80be-4879-9898-90e70465c23c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af67419-d04c-432e-b277-3302e2f54f6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:49:44 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:49:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39335d2-a308-49e1-983a-6e4bb5a197f2]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating existing volume attachment record: fe3d52f2-0270-45de-8e8d-a5a1d8ece83a {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:49:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully created port: 6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully created port: 4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully created port: 142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully created port: 286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully created port: 49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: 6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-6d244ad1-2ec1-403c-a79a-fc55601d3713. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:48 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:49:48 user nova-compute[75266]: INFO nova.compute.claims [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Claim successful on node user
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:49:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-c96774b3-2a86-4fae-9733-45e0dc0f4f49. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.policy [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:49:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Creating image(s)
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "/opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "/opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "/opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: 4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk 1073741824" returned: 0 in 0.051s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.207s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: 142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Cannot resize image /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Ensure instance console log exists: /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.network.neutron [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Successfully created port: 6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: 286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Successfully updated port: 6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquired lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-changed-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Refreshing instance network info cache due to event network-changed-6fb14075-40d0-488e-86ee-32b1d5ce7c20. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Acquiring lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Updating instance_info_cache with network_info: [{"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Releasing lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Instance network_info: |[{"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Acquired lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Refreshing network info cache for port 6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Start _get_guest_xml network_info=[{"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:49:51 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:51 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-10295081',display_name='tempest-VolumesActionsTest-instance-10295081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-10295081',id=23,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-kt2ig09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:49Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=04175bce-9dc6-432e-8c06-e55f4e2aeb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lazy-loading 'pci_devices' on Instance uuid 04175bce-9dc6-432e-8c06-e55f4e2aeb65 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-4c25b79e-79ff-420f-bdd9-9392bd703156. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Successfully updated port: 49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:49:51 user nova-compute[75266]:   <uuid>04175bce-9dc6-432e-8c06-e55f4e2aeb65</uuid>
Nov 28 00:49:51 user nova-compute[75266]:   <name>instance-00000017</name>
Nov 28 00:49:51 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:49:51 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:49:51 user nova-compute[75266]:   <metadata>
Nov 28 00:49:51 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:49:51 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:name>tempest-VolumesActionsTest-instance-10295081</nova:name>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:49:51</nova:creationTime>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:49:51 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:49:51 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:owner>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:user uuid="f1d154145c6944a790da943c75adb000">tempest-VolumesActionsTest-1457578131-project-member</nova:user>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:project uuid="6dfd77666ef94a61b16d07a624036091">tempest-VolumesActionsTest-1457578131</nova:project>
Nov 28 00:49:51 user nova-compute[75266]:       </nova:owner>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:49:51 user nova-compute[75266]:       <nova:ports>
Nov 28 00:49:51 user nova-compute[75266]:         <nova:port uuid="6fb14075-40d0-488e-86ee-32b1d5ce7c20">
Nov 28 00:49:51 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:49:51 user nova-compute[75266]:         </nova:port>
Nov 28 00:49:51 user nova-compute[75266]:       </nova:ports>
Nov 28 00:49:51 user nova-compute[75266]:     </nova:instance>
Nov 28 00:49:51 user nova-compute[75266]:   </metadata>
Nov 28 00:49:51 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:49:51 user nova-compute[75266]:     <system>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="serial">04175bce-9dc6-432e-8c06-e55f4e2aeb65</entry>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="uuid">04175bce-9dc6-432e-8c06-e55f4e2aeb65</entry>
Nov 28 00:49:51 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:49:51 user nova-compute[75266]:     </system>
Nov 28 00:49:51 user nova-compute[75266]:   </sysinfo>
Nov 28 00:49:51 user nova-compute[75266]:   <os>
Nov 28 00:49:51 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:49:51 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:49:51 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:49:51 user nova-compute[75266]:   </os>
Nov 28 00:49:51 user nova-compute[75266]:   <features>
Nov 28 00:49:51 user nova-compute[75266]:     <acpi/>
Nov 28 00:49:51 user nova-compute[75266]:     <apic/>
Nov 28 00:49:51 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:49:51 user nova-compute[75266]:   </features>
Nov 28 00:49:51 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:49:51 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:49:51 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:49:51 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:49:51 user nova-compute[75266]:   </clock>
Nov 28 00:49:51 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:49:51 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:49:51 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:49:51 user nova-compute[75266]:   </cpu>
Nov 28 00:49:51 user nova-compute[75266]:   <devices>
Nov 28 00:49:51 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:49:51 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:49:51 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk"/>
Nov 28 00:49:51 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:49:51 user nova-compute[75266]:     </disk>
Nov 28 00:49:51 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:49:51 user nova-compute[75266]:       <mac address="fa:16:3e:b0:ca:1e"/>
Nov 28 00:49:51 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:49:51 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:49:51 user nova-compute[75266]:       <target dev="tap6fb14075-40"/>
Nov 28 00:49:51 user nova-compute[75266]:     </interface>
Nov 28 00:49:51 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:49:51 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/console.log" append="off"/>
Nov 28 00:49:51 user nova-compute[75266]:     </serial>
Nov 28 00:49:51 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:49:51 user nova-compute[75266]:     <video>
Nov 28 00:49:51 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:49:51 user nova-compute[75266]:     </video>
Nov 28 00:49:51 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:49:51 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:49:51 user nova-compute[75266]:     </rng>
Nov 28 00:49:51 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:49:51 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:49:51 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:49:51 user nova-compute[75266]:     </memballoon>
Nov 28 00:49:51 user nova-compute[75266]:   </devices>
Nov 28 00:49:51 user nova-compute[75266]: </domain>
Nov 28 00:49:51 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-10295081',display_name='tempest-VolumesActionsTest-instance-10295081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-10295081',id=23,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-kt2ig09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:49Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=04175bce-9dc6-432e-8c06-e55f4e2aeb65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_vif [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f261d49b-43bd-56a3-b452-9719edfbfeec', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fb14075-40, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fb14075-40, col_values=(('qos', UUID('70a82c3c-ac1b-4faa-9835-f970ced1507c')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fb14075-40, col_values=(('external_ids', {'iface-id': '6fb14075-40d0-488e-86ee-32b1d5ce7c20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:ca:1e', 'vm-uuid': '04175bce-9dc6-432e-8c06-e55f4e2aeb65'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:51 user nova-compute[75266]: INFO os_vif [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40')
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] No VIF found with MAC fa:16:3e:b0:ca:1e, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:49:51 user nova-compute[75266]: INFO nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Booting with volume dce85e62-5265-44e8-ae95-426ad618a9cd at /dev/vdb
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e88cbb-ef66-4e4c-a9ac-80c904047821]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17fd86-f5da-4d04-9910-97e8ef3ae6a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[03767d3d-9957-40e5-8671-6bf34a972d9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1665596-86af-424c-92b2-e6388749ce4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Updated VIF entry in instance network info cache for port 6fb14075-40d0-488e-86ee-32b1d5ce7c20. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Updating instance_info_cache with network_info: [{"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Releasing lock "refresh_cache-04175bce-9dc6-432e-8c06-e55f4e2aeb65" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:49:51 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[836c5463-49f8-474f-b9a8-8084984cfe3e]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating existing volume attachment record: 9c259aae-433e-41f7-bced-5778b8ee9111 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-142e2086-37d6-40f3-a928-4989daf67ba9. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-286b6758-a4bb-46ee-8766-d16fff0e3b25. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] No waiting events found dispatching network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:53 user nova-compute[75266]: WARNING nova.compute.manager [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received unexpected event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance with vm_state building and task_state spawning.
Nov 28 00:49:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-49e01d3b-dcb9-4186-bba1-8afe6a8ac210. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance network_info: |[{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updated VIF entry in instance network info cache for port 49e01d3b-dcb9-4186-bba1-8afe6a8ac210. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:49:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:49:55 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Instance spawned successfully.
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] No waiting events found dispatching network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:49:55 user nova-compute[75266]: WARNING nova.compute.manager [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received unexpected event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance with vm_state building and task_state spawning.
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:49:55 user nova-compute[75266]: INFO nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 28 00:49:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:49:55 user nova-compute[75266]: INFO nova.compute.manager [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Took 6.59 seconds to build instance.
Nov 28 00:49:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.697s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:49:58 user nova-compute[75266]: INFO nova.compute.claims [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Claim successful on node user
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:49:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.policy [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:49:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Creating image(s)
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk 1073741824" returned: 0 in 0.062s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: INFO nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Booting with volume 7fc842d4-89dc-4631-b51f-18f57c6d8711 at /dev/vdc
Nov 28 00:49:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Successfully created port: 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1ac69-3a89-4309-a114-177165771332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[499085de-0e26-44db-8416-05fa877d62bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:49:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee79dd-7c26-4d6e-9cd1-f16b24513b32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967e500-c1d7-4a11-9ed9-92a9d16fe67d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.241s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:00 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6870edb9-a401-4834-a070-c7d353ba2da4]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating existing volume attachment record: e88b2d4c-88bf-4a53-bb4e-280951167057 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Cannot resize image /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Ensure instance console log exists: /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Successfully updated port: 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-changed-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing instance network info cache due to event network-changed-2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:50:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance network_info: |[{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start _get_guest_xml network_info=[{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:50:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1287657777',display_name='tempest-ServerRescueNegativeTestJSON-server-1287657777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1287657777',id=24,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbgL6uxmLC3MZN+RrqUPtpw5FpUn8maTx0Cf4LCwQCRvDd2+IMQRtiAJBB/3y8VPHozvUpRK0AlMQnI/+Jt36ZBNau3gnhdcxDotPvQEvFguuKb5CmCFRaaKSD+AGTLA==',key_name='tempest-keypair-986818562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-tlhozz48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad5a4c6583f42b39eda624923ded77b',uuid=a835216a-04a1-4660-a458-13cca79489c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:50:01 user nova-compute[75266]:   <uuid>a835216a-04a1-4660-a458-13cca79489c3</uuid>
Nov 28 00:50:01 user nova-compute[75266]:   <name>instance-00000018</name>
Nov 28 00:50:01 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:50:01 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:50:01 user nova-compute[75266]:   <metadata>
Nov 28 00:50:01 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:50:01 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1287657777</nova:name>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:50:01</nova:creationTime>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:50:01 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:50:01 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:owner>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:50:01 user nova-compute[75266]:       </nova:owner>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:50:01 user nova-compute[75266]:       <nova:ports>
Nov 28 00:50:01 user nova-compute[75266]:         <nova:port uuid="2df0bea2-3afd-4093-909a-2d0026656990">
Nov 28 00:50:01 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 00:50:01 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:01 user nova-compute[75266]:       </nova:ports>
Nov 28 00:50:01 user nova-compute[75266]:     </nova:instance>
Nov 28 00:50:01 user nova-compute[75266]:   </metadata>
Nov 28 00:50:01 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:50:01 user nova-compute[75266]:     <system>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="serial">a835216a-04a1-4660-a458-13cca79489c3</entry>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="uuid">a835216a-04a1-4660-a458-13cca79489c3</entry>
Nov 28 00:50:01 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:50:01 user nova-compute[75266]:     </system>
Nov 28 00:50:01 user nova-compute[75266]:   </sysinfo>
Nov 28 00:50:01 user nova-compute[75266]:   <os>
Nov 28 00:50:01 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:50:01 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:50:01 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:50:01 user nova-compute[75266]:   </os>
Nov 28 00:50:01 user nova-compute[75266]:   <features>
Nov 28 00:50:01 user nova-compute[75266]:     <acpi/>
Nov 28 00:50:01 user nova-compute[75266]:     <apic/>
Nov 28 00:50:01 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:50:01 user nova-compute[75266]:   </features>
Nov 28 00:50:01 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:50:01 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:50:01 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:50:01 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:50:01 user nova-compute[75266]:   </clock>
Nov 28 00:50:01 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:50:01 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:50:01 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:50:01 user nova-compute[75266]:   </cpu>
Nov 28 00:50:01 user nova-compute[75266]:   <devices>
Nov 28 00:50:01 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:50:01 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:50:01 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk"/>
Nov 28 00:50:01 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:50:01 user nova-compute[75266]:     </disk>
Nov 28 00:50:01 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:01 user nova-compute[75266]:       <mac address="fa:16:3e:74:a5:a8"/>
Nov 28 00:50:01 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:01 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:01 user nova-compute[75266]:       <target dev="tap2df0bea2-3a"/>
Nov 28 00:50:01 user nova-compute[75266]:     </interface>
Nov 28 00:50:01 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:50:01 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/console.log" append="off"/>
Nov 28 00:50:01 user nova-compute[75266]:     </serial>
Nov 28 00:50:01 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:50:01 user nova-compute[75266]:     <video>
Nov 28 00:50:01 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:01 user nova-compute[75266]:     </video>
Nov 28 00:50:01 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:50:01 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:50:01 user nova-compute[75266]:     </rng>
Nov 28 00:50:01 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:50:01 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:50:01 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:50:01 user nova-compute[75266]:     </memballoon>
Nov 28 00:50:01 user nova-compute[75266]:   </devices>
Nov 28 00:50:01 user nova-compute[75266]: </domain>
Nov 28 00:50:01 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1287657777',display_name='tempest-ServerRescueNegativeTestJSON-server-1287657777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1287657777',id=24,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbgL6uxmLC3MZN+RrqUPtpw5FpUn8maTx0Cf4LCwQCRvDd2+IMQRtiAJBB/3y8VPHozvUpRK0AlMQnI/+Jt36ZBNau3gnhdcxDotPvQEvFguuKb5CmCFRaaKSD+AGTLA==',key_name='tempest-keypair-986818562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-tlhozz48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad5a4c6583f42b39eda624923ded77b',uuid=a835216a-04a1-4660-a458-13cca79489c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG os_vif [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '474e8265-0251-592d-a167-936067265324', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df0bea2-3a, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df0bea2-3a, col_values=(('qos', UUID('bce6e4cd-8bc7-41df-b6b4-e85beda57265')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df0bea2-3a, col_values=(('external_ids', {'iface-id': '2df0bea2-3afd-4093-909a-2d0026656990', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:a5:a8', 'vm-uuid': 'a835216a-04a1-4660-a458-13cca79489c3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:01 user nova-compute[75266]: INFO os_vif [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a')
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:74:a5:a8, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updated VIF entry in instance network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:02 user nova-compute[75266]: INFO nova.compute.manager [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attaching volume 1c7108b3-5be2-44fd-95f0-4155bbde069b to /dev/vdb
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c2c43-582e-4e60-9708-d054fb821ab0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762e9e7-1e3b-470c-ae11-245473d26726]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8dc1f-f0e4-4e38-825c-89337888b935]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b39b4-bc11-4278-80ed-4ab116a2212a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:02 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:50:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c953fae8-3490-474b-bc88-c8b39aaafd5e]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating existing volume attachment record: 72ef4eec-0360-4934-8f9e-5ef8a96d3ae1 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:03 user nova-compute[75266]: WARNING nova.compute.manager [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state building and task_state spawning.
Nov 28 00:50:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:50:05 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance spawned successfully.
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:05 user nova-compute[75266]: WARNING nova.compute.manager [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state building and task_state spawning.
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:05 user nova-compute[75266]: INFO nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 28 00:50:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:50:05 user nova-compute[75266]: INFO nova.compute.manager [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Took 6.73 seconds to build instance.
Nov 28 00:50:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:50:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Creating image(s)
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Ensure instance console log exists: /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Start _get_guest_xml network_info=[{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCBxczyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 'serial': 'a6937f5b-e643-48c5-9a70-2ff88d4e5f2d'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'fe3d52f2-0270-45de-8e8d-a5a1d8ece83a', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZKdhQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3', 'attached_at': '', 'detached_at': '', 'volume_id': 'dce85e62-5265-44e8-ae95-426ad618a9cd', 'serial': 'dce85e62-5265-44e8-ae95-426ad618a9cd'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '9c259aae-433e-41f7-bced-5778b8ee9111', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvkGYsah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3', 'attached_at': '', 'detached_at': '', 'volume_id': '7fc842d4-89dc-4631-b51f-18f57c6d8711', 'serial': '7fc842d4-89dc-4631-b51f-18f57c6d8711'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e88b2d4c-88bf-4a53-bb4e-280951167057', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:50:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCBxczyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:07 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa9536c-3c57-48ae-900a-84e4f6f2233e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:50:07 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b52f2-e231-47e6-85bc-16343e07bd46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d] added
Nov 28 00:50:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b23203a-466d-45ba-b20a-acf51e292dd5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4f385-01a3-47bd-a91b-532a7b00949a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCBxczyv {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCBxczyv" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd70671-5131-498e-b288-e76a6acfe0a1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCBxczyv'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb24ef0-aab6-4393-af72-f754d1256058]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a99ad7-0723-4156-9985-52281fc25236]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14297399-4c71-4aa2-80ac-7ba8b9053130]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260]
Nov 28 00:50:08 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e908ef7-7b9a-41d8-8248-ce6549faddfe]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3393108-0e77-4064-9eed-d19224cba5ef]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:08 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557f834-3884-4d05-a7fa-1d96adbd14f5]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCBxczyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26332386339386639', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332386339386639', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZKdhQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:09 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:09 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:09 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18a87d-9c3f-4ee0-a9d1-cef7714704e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:50:09 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377c169-fa0b-43ba-b558-90bd4080b807]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd] added
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b365a-1703-4d37-b2f4-1fc35c6d8c70]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08270c89-de7e-440f-9615-82153d777978]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoZKdhQj {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoZKdhQj" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f8404-1c0f-42bb-ae4d-4d2a0c209e88]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoZKdhQj'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35702963-367c-49f7-98a0-8a591710e5f2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11bda1-5b02-446e-b90d-e9604d65552d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb5c91d-0373-41d2-a087-bb01bfe1c0f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260]
Nov 28 00:50:09 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11638ef-845b-4336-8ff4-1ae937bea3b6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243f47a-b5f6-401e-a872-0f54d1e047ab]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:09 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bdf388-5903-473c-849a-5732a4aee4e9]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZKdhQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiFZgoYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:09 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23761663161303866', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761663161303866', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.619s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:10 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebc495-e60a-4475-8372-32998502adce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvkGYsah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:50:10 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4cbf3-5653-4637-be74-6fe292165c8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b] added
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7418dec2-a909-4438-bdc2-1d3ea9fc7c17]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80024f2-e584-4a29-bb0d-e145cefb47a2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiFZgoYb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiFZgoYb" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff06a3-0de0-4d29-9823-7896bc0964b0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiFZgoYb'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:10 user nova-compute[75266]: INFO nova.compute.manager [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Detaching volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:50:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[277eb724-2e27-48a7-a06d-52b48ef9a603]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661e689-1e77-4ad4-a392-7df17095e39b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: INFO nova.virt.block_device [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Attempting to driver detach volume 5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 from mountpoint /dev/vdb
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Attempting to detach device vdb from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:50:10 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:10 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:50:10 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:10 user nova-compute[75266]:   <serial>5dcc4ca3-dba8-4e3f-b69a-2093ba519c05</serial>
Nov 28 00:50:10 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:50:10 user nova-compute[75266]: </disk>
Nov 28 00:50:10 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:50:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully detached device vdb from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the persistent domain config.
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:50:10 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:10 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:50:10 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:10 user nova-compute[75266]:   <serial>5dcc4ca3-dba8-4e3f-b69a-2093ba519c05</serial>
Nov 28 00:50:10 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:50:10 user nova-compute[75266]: </disk>
Nov 28 00:50:10 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e111d1-cf80-4516-a36d-575fb9ff5852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260]
Nov 28 00:50:10 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a35919-ea5c-4a20-8b60-84c1c61de5dc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9451b2-2f04-4f7e-b1f1-c2c65db220e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:10 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:50:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a5e0b-ff8c-4ccf-9388-114e43217baa]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiFZgoYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== connect_volume: return (2023ms) {'type': 'block', 'scsi_wwn': '23738616363353632', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738616363353632', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.369s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:12 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:12 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4132d7a-e5e7-4241-ac08-457801cfc1d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:50:12 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:50:12 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:12 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:50:12 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:12 user nova-compute[75266]:   <serial>1c7108b3-5be2-44fd-95f0-4155bbde069b</serial>
Nov 28 00:50:12 user nova-compute[75266]: </disk>
Nov 28 00:50:12 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfef3504-ca34-40da-9639-019022ffa3ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711] added
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7913eb27-563d-4286-9bbe-9714275050a5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d790978d-4e24-46f0-9f23-905cba7811d6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvkGYsah {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvkGYsah" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8038484-8812-49c9-9f04-ea6d5a867ac8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mvkGYsah'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[800bedc1-7ffd-4c8e-964c-0aaa6926fcfa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[19878aec-0113-4d5d-85dc-3ef7e94dac84]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4218bf1-d1b5-4add-8a85-6f591eef7869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260]
Nov 28 00:50:12 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad8aa89-1691-4f83-bcb0-2856bde5aa16]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5401d-3d25-40cb-838e-6b0440efb92e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:12 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969a9fc-e9f8-4cfe-8c88-ccdac462c983]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No VIF found with MAC fa:16:3e:d1:c0:61, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:50:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.594s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvkGYsah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== connect_volume: return (2693ms) {'type': 'block', 'scsi_wwn': '26163346434323435', 'path': '/dev/sdh'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163346434323435', 'path': '/dev/sdh'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lazy-loading 'pci_devices' on Instance uuid f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:50:13 user nova-compute[75266]:   <uuid>f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3</uuid>
Nov 28 00:50:13 user nova-compute[75266]:   <name>instance-00000016</name>
Nov 28 00:50:13 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:50:13 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:50:13 user nova-compute[75266]:   <metadata>
Nov 28 00:50:13 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:50:13 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:name>tempest-device-tagging-server-211957985</nova:name>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:50:07</nova:creationTime>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:50:13 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:50:13 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:owner>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:user uuid="8a3f3d233d494eedb5263da5485c8271">tempest-TaggedBootDevicesTest_v242-813468473-project-member</nova:user>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:project uuid="4944a899309047f9979213a267d79dc4">tempest-TaggedBootDevicesTest_v242-813468473</nova:project>
Nov 28 00:50:13 user nova-compute[75266]:       </nova:owner>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:50:13 user nova-compute[75266]:       <nova:ports>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="6d244ad1-2ec1-403c-a79a-fc55601d3713">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="c96774b3-2a86-4fae-9733-45e0dc0f4f49">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="4c25b79e-79ff-420f-bdd9-9392bd703156">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="142e2086-37d6-40f3-a928-4989daf67ba9">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="286b6758-a4bb-46ee-8766-d16fff0e3b25">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:         <nova:port uuid="49e01d3b-dcb9-4186-bba1-8afe6a8ac210">
Nov 28 00:50:13 user nova-compute[75266]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 00:50:13 user nova-compute[75266]:         </nova:port>
Nov 28 00:50:13 user nova-compute[75266]:       </nova:ports>
Nov 28 00:50:13 user nova-compute[75266]:     </nova:instance>
Nov 28 00:50:13 user nova-compute[75266]:   </metadata>
Nov 28 00:50:13 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:50:13 user nova-compute[75266]:     <system>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="serial">f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3</entry>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="uuid">f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3</entry>
Nov 28 00:50:13 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:50:13 user nova-compute[75266]:     </system>
Nov 28 00:50:13 user nova-compute[75266]:   </sysinfo>
Nov 28 00:50:13 user nova-compute[75266]:   <os>
Nov 28 00:50:13 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:50:13 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:50:13 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:50:13 user nova-compute[75266]:   </os>
Nov 28 00:50:13 user nova-compute[75266]:   <features>
Nov 28 00:50:13 user nova-compute[75266]:     <acpi/>
Nov 28 00:50:13 user nova-compute[75266]:     <apic/>
Nov 28 00:50:13 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:50:13 user nova-compute[75266]:   </features>
Nov 28 00:50:13 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:50:13 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:50:13 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:50:13 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:50:13 user nova-compute[75266]:   </clock>
Nov 28 00:50:13 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:50:13 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:50:13 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:50:13 user nova-compute[75266]:   </cpu>
Nov 28 00:50:13 user nova-compute[75266]:   <devices>
Nov 28 00:50:13 user nova-compute[75266]:     <disk type="file" device="cdrom">
Nov 28 00:50:13 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 00:50:13 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/disk.config"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="hda" bus="ide"/>
Nov 28 00:50:13 user nova-compute[75266]:     </disk>
Nov 28 00:50:13 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:50:13 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:13 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <serial>a6937f5b-e643-48c5-9a70-2ff88d4e5f2d</serial>
Nov 28 00:50:13 user nova-compute[75266]:     </disk>
Nov 28 00:50:13 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:50:13 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:13 user nova-compute[75266]:       <source dev="/dev/sdf"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <serial>dce85e62-5265-44e8-ae95-426ad618a9cd</serial>
Nov 28 00:50:13 user nova-compute[75266]:     </disk>
Nov 28 00:50:13 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:50:13 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:13 user nova-compute[75266]:       <source dev="/dev/sdh"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="vdc" bus="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <serial>7fc842d4-89dc-4631-b51f-18f57c6d8711</serial>
Nov 28 00:50:13 user nova-compute[75266]:     </disk>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:5f:ec:53"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tap6d244ad1-2e"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:2f:2e:2c"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tapc96774b3-2a"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:f1:2c:02"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tapc6c26ecd-15"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:25:cd:22"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tap4c25b79e-79"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:ec:f1:72"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tap142e2086-37"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:56:b6:cb"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tap286b6758-a4"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:50:13 user nova-compute[75266]:       <mac address="fa:16:3e:97:63:a7"/>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:50:13 user nova-compute[75266]:       <target dev="tap49e01d3b-dc"/>
Nov 28 00:50:13 user nova-compute[75266]:     </interface>
Nov 28 00:50:13 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:50:13 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/console.log" append="off"/>
Nov 28 00:50:13 user nova-compute[75266]:     </serial>
Nov 28 00:50:13 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:50:13 user nova-compute[75266]:     <video>
Nov 28 00:50:13 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:50:13 user nova-compute[75266]:     </video>
Nov 28 00:50:13 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:50:13 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:50:13 user nova-compute[75266]:     </rng>
Nov 28 00:50:13 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:50:13 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:50:13 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:50:13 user nova-compute[75266]:     </memballoon>
Nov 28 00:50:13 user nova-compute[75266]:   </devices>
Nov 28 00:50:13 user nova-compute[75266]: </domain>
Nov 28 00:50:13 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42d17622-42c9-5c71-aa1e-c3b48b419336', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d244ad1-2e, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d244ad1-2e, col_values=(('qos', UUID('ca52bd48-cb15-4583-b999-0a793585ea46')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d244ad1-2e, col_values=(('external_ids', {'iface-id': '6d244ad1-2ec1-403c-a79a-fc55601d3713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ec:53', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47830f25-92d4-50c7-bd8e-2d1ce0ad52b0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc96774b3-2a, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc96774b3-2a, col_values=(('qos', UUID('d5eb76b4-ebaa-4085-b59d-21365f5463f1')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc96774b3-2a, col_values=(('external_ids', {'iface-id': 'c96774b3-2a86-4fae-9733-45e0dc0f4f49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:2e:2c', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47e5812c-a4f1-50c1-8078-b70f43c23c6e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6c26ecd-15, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6c26ecd-15, col_values=(('qos', UUID('29ad856b-b4bf-450f-bece-a6f201234e3e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6c26ecd-15, col_values=(('external_ids', {'iface-id': 'c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:2c:02', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edd5d62c-1b93-501b-86c9-f3bfd07eb434', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c25b79e-79, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c25b79e-79, col_values=(('qos', UUID('f14d3b7b-7051-4440-a4fd-69ebc6c75e24')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c25b79e-79, col_values=(('external_ids', {'iface-id': '4c25b79e-79ff-420f-bdd9-9392bd703156', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:cd:22', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8520b427-1ee4-5737-bfbc-1956ec3bf0e1', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap142e2086-37, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap142e2086-37, col_values=(('qos', UUID('e39911e6-cce9-4674-bb0a-1160210c44e7')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap142e2086-37, col_values=(('external_ids', {'iface-id': '142e2086-37d6-40f3-a928-4989daf67ba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:f1:72', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbccbbdd-4f05-5d01-a271-4e8d1619cff4', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap286b6758-a4, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap286b6758-a4, col_values=(('qos', UUID('b9232cbd-7a71-4fba-8d4a-71ca0293566c')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap286b6758-a4, col_values=(('external_ids', {'iface-id': '286b6758-a4bb-46ee-8766-d16fff0e3b25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:b6:cb', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4')
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5c12a0c-6497-584a-b0ff-c3f529100fe0', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49e01d3b-dc, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49e01d3b-dc, col_values=(('qos', UUID('05c36069-1d6b-4e84-a1c8-b99276b2bd99')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49e01d3b-dc, col_values=(('external_ids', {'iface-id': '49e01d3b-dcb9-4186-bba1-8afe6a8ac210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:63:a7', 'vm-uuid': 'f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:13 user nova-compute[75266]: INFO os_vif [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc')
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] No BDM found with device name hda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] No VIF found with MAC fa:16:3e:5f:ec:53, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] No VIF found with MAC fa:16:3e:ec:f1:72, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:50:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Using config drive
Nov 28 00:50:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Creating config drive at /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/disk.config
Nov 28 00:50:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8sfcs3dn {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8sfcs3dn" returned: 0 in 0.065s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:14 user nova-compute[75266]: INFO nova.compute.manager [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Detaching volume 1c7108b3-5be2-44fd-95f0-4155bbde069b
Nov 28 00:50:14 user nova-compute[75266]: INFO nova.virt.block_device [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attempting to driver detach volume 1c7108b3-5be2-44fd-95f0-4155bbde069b from mountpoint /dev/vdb
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Attempting to detach device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:50:14 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:14 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:50:14 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:14 user nova-compute[75266]:   <serial>1c7108b3-5be2-44fd-95f0-4155bbde069b</serial>
Nov 28 00:50:14 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:50:14 user nova-compute[75266]: </disk>
Nov 28 00:50:14 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:50:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config.
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:50:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:50:14 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:14 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:50:14 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:14 user nova-compute[75266]:   <serial>1c7108b3-5be2-44fd-95f0-4155bbde069b</serial>
Nov 28 00:50:14 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:50:14 user nova-compute[75266]: </disk>
Nov 28 00:50:14 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:16 user nova-compute[75266]: WARNING nova.compute.manager [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance with vm_state building and task_state spawning.
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:16 user nova-compute[75266]: WARNING nova.compute.manager [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance with vm_state building and task_state spawning.
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:17 user nova-compute[75266]: WARNING nova.compute.manager [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 for instance with vm_state building and task_state spawning.
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:18 user nova-compute[75266]: WARNING nova.compute.manager [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance with vm_state building and task_state spawning.
Nov 28 00:50:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:19 user nova-compute[75266]: WARNING nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 for instance with vm_state building and task_state spawning.
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:19 user nova-compute[75266]: WARNING nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance with vm_state building and task_state spawning.
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:19 user nova-compute[75266]: WARNING nova.compute.manager [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance with vm_state building and task_state spawning.
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:50:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance spawned successfully.
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:50:20 user nova-compute[75266]: INFO nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Took 12.46 seconds to spawn the instance on the hypervisor.
Nov 28 00:50:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:20 user nova-compute[75266]: INFO nova.compute.manager [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Took 37.02 seconds to build instance.
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.120s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:50:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7205MB free_disk=25.22292709350586GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:50:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:50:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 is timed out.
Nov 28 00:50:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully detached device vdb from instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 from the live domain config.
Nov 28 00:50:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqYiSZQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:31 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9418a4a-9fe8-41e1-81c1-3f9765b26569]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:50:31 user nova-compute[75266]: No targets found.
Nov 28 00:50:31 user nova-compute[75266]: iSNS:
Nov 28 00:50:31 user nova-compute[75266]: No targets found.
Nov 28 00:50:31 user nova-compute[75266]: STATIC:
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:50:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:31 user nova-compute[75266]: FIRMWARE:
Nov 28 00:50:31 user nova-compute[75266]: No targets found.
Nov 28 00:50:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:50:31 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:50:31 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d11b771-8394-4372-89fb-3970111467d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba8ad4-d80d-4756-8640-26ab45d52706]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:31 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada38160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c31560-8728-4ee9-a306-40bf0da3bcb7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9420b4-dbdf-4b37-9767-18c0ba6a51b9]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ed2ac6-2db1-40f2-b58b-e3be9aadba8d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7b530-7608-4b1b-aa12-99d8084ee96f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2944dd2d-e7a3-4a22-b266-3b78c0547174]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664f3e0-8223-4ba3-90a5-e0cd9bb5077a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260]
Nov 28 00:50:31 user nova-compute[75266]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf3d47a-6c2d-49db-8f94-ec4ecc46a954]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== disconnect_volume: return (320ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:50:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'flavor' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'flavor' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:35 user nova-compute[75266]: INFO nova.compute.manager [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Attaching volume 307a1ca3-5fc8-4700-849a-6b2cbcacd748 to /dev/vdb
Nov 28 00:50:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 is timed out.
Nov 28 00:50:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config.
Nov 28 00:50:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiFZgoYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:35 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7069a49-45eb-4f62-830a-9a3b9a90e96f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:50:35 user nova-compute[75266]: No targets found.
Nov 28 00:50:35 user nova-compute[75266]: iSNS:
Nov 28 00:50:35 user nova-compute[75266]: No targets found.
Nov 28 00:50:35 user nova-compute[75266]: STATIC:
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:50:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:35 user nova-compute[75266]: FIRMWARE:
Nov 28 00:50:35 user nova-compute[75266]: No targets found.
Nov 28 00:50:35 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:50:35 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:50:35 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1834d34-7ac2-4498-b8d3-ad927d579e90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[692590e4-5d3c-4f12-aae3-1eb2f417ed57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[744205ab-be1a-4678-b1cb-1a2aa790a422]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68f67e-af44-499c-827f-ee332f8a1add]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b (non-flash)
Nov 28 00:50:35 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:35 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada38f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5df9d3-9e76-42e6-ac43-d5e80d54a635]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf52e0-fb15-4897-9f14-d2b241e4c924]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3551c-b4ff-40f7-85e4-5a48aee0330a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:35 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8915535c-83b2-46b3-ae17-632359a4b5dd]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating existing volume attachment record: 34ff7bbd-c720-4718-b644-e66bdede55ae {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63bb86c-df09-47ba-9a7e-3aedc3d6ca29]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56189684-d56a-4c0f-9548-23fdb59b79cd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[07582771-c3ee-40ab-a8bc-de33183ba986]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b37f7a1-b949-4e5d-9624-9d32b8da685a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[24740863-2641-440f-abd4-821c1f51e772]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260]
Nov 28 00:50:35 user nova-compute[75266]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:35 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c7108b3-5be2-44fd-95f0-4155bbde069b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[875443f4-09ff-418a-8bed-be18fc0ec7d1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== disconnect_volume: return (432ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:50:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.770s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-changed-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Refreshing instance network info cache due to event network-changed-2d3f6903-a024-4928-afba-ce8273784c3e. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Acquiring lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Acquired lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Refreshing network info cache for port 2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updated VIF entry in instance network info cache for port 2d3f6903-a024-4928-afba-ce8273784c3e. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating instance_info_cache with network_info: [{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Releasing lock "refresh_cache-72e2c36d-6ae4-4af8-8511-5d36532b76e0" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:41 user nova-compute[75266]: INFO nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Rebuilding instance
Nov 28 00:50:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:50:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance destroyed successfully.
Nov 28 00:50:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance destroyed successfully.
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935386610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3f6903-a0, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b31bae9-6bbc-4a0e-a3bc-4ec92b44c4ef) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:42 user nova-compute[75266]: INFO os_vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0')
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:42 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9303ee-ae43-47bd-8578-9207c624696f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:50:42 user nova-compute[75266]: No targets found.
Nov 28 00:50:42 user nova-compute[75266]: iSNS:
Nov 28 00:50:42 user nova-compute[75266]: No targets found.
Nov 28 00:50:42 user nova-compute[75266]: STATIC:
Nov 28 00:50:42 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:50:42 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:42 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:42 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:50:42 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:42 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:42 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:50:42 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:42 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:42 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:50:42 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:42 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:42 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:50:42 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:42 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:42 user nova-compute[75266]: FIRMWARE:
Nov 28 00:50:42 user nova-compute[75266]: No targets found.
Nov 28 00:50:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:50:42 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:50:42 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:42 user nova-compute[75266]: WARNING nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state active and task_state rebuilding.
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:42 user nova-compute[75266]: WARNING nova.compute.manager [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state active and task_state rebuilding.
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf57eb5-7b70-4939-ab57-1bdf52e72fb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ea268-b043-4719-961f-8c0f68f2e223]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:42 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c5ec3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c9a400-7dad-43f8-be6a-bbacae39bd9f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7df125-744c-4273-a653-4b4c56dbd162]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e61d98-ce82-4f75-839e-0760d1981cb2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[04581af5-5f6e-401f-84cf-3300836e2630]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874497e-e4eb-4694-b0d4-98a33dd0617e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2107a-86bc-439b-9b54-777d2c4af5b3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]
Nov 28 00:50:42 user nova-compute[75266]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb029c-c937-4086-89ff-d46d53bd4d9c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== disconnect_volume: return (349ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:50:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deleting instance files /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0_del
Nov 28 00:50:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deletion of /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0_del complete
Nov 28 00:50:43 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 could not be found.
Nov 28 00:50:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:43 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e271953a-387e-49ec-a8dd-234d2fbc4c98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:50:43 user nova-compute[75266]: No targets found.
Nov 28 00:50:43 user nova-compute[75266]: iSNS:
Nov 28 00:50:43 user nova-compute[75266]: No targets found.
Nov 28 00:50:43 user nova-compute[75266]: STATIC:
Nov 28 00:50:43 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:50:43 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:43 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:43 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:50:43 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:43 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:43 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:50:43 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:43 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:43 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:50:43 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:43 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:43 user nova-compute[75266]: FIRMWARE:
Nov 28 00:50:43 user nova-compute[75266]: No targets found.
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:50:43 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:50:43 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad13545-ad8c-4cc5-997f-c64918e90ca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a8c20-01e2-4b76-8505-c534e753c8d1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c5eb520>, {}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Disconnecting from: [] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== disconnect_volume: return (73ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:43 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:43 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:43 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a3134-2a3c-4d2a-aa16-71d3e3651bb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:50:43 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb6b61-0231-42bc-8cdc-2c9065609f0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0a2d3-882a-4666-a7fb-9f0d0f9c81f1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ce094-acfa-4c7a-a49d-377a3f34484e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2236b-aee5-4978-bac4-96293c531c4f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGKstYvH'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff52a81-f403-4c23-bf23-36dbde7b9a61]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b67b0-56ee-4b3c-b19d-a104e69ecd1f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefc3d9-f09b-4a8d-b211-580945238353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:50:43 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca795f-d1c7-4b84-bdbb-bbae32e9ff77]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc037527-719c-4029-ad9a-cd1a888bb4ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:50:43 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[96099232-99b9-4089-83b9-ce94b20a4d8b]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Preparing to wait for external event volume-reimaged-c2b4dff1-92b2-4410-a861-a1efbadb6787 {{(pid=75266) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:50:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'flavor' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:50:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:50:44 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:50:44 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:50:44 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:50:44 user nova-compute[75266]:   <serial>307a1ca3-5fc8-4700-849a-6b2cbcacd748</serial>
Nov 28 00:50:44 user nova-compute[75266]: </disk>
Nov 28 00:50:44 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:50:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:50:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No VIF found with MAC fa:16:3e:e3:c0:e9, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:50:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.009s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Stashing vm_state: active {{(pid=75266) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 00:50:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:50:47 user nova-compute[75266]: INFO nova.compute.claims [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Claim successful on node user
Nov 28 00:50:47 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating resource usage from migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3
Nov 28 00:50:48 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.530s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:48 user nova-compute[75266]: INFO nova.compute.manager [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Migrating
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:48 user nova-compute[75266]: INFO nova.compute.rpcapi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Starting migrate_disk_and_power_off {{(pid=75266) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:49 user nova-compute[75266]: WARNING nova.compute.manager [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state active and task_state resize_migrating.
Nov 28 00:50:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance destroyed successfully.
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1755ff-55, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9475bfd1-1ba0-4f0a-aec8-d56d7e9eb2b4) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:50:49 user nova-compute[75266]: INFO os_vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:50:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:49 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9d963-a840-4556-9532-81b6dcaf7556]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:50:49 user nova-compute[75266]: No targets found.
Nov 28 00:50:49 user nova-compute[75266]: iSNS:
Nov 28 00:50:49 user nova-compute[75266]: No targets found.
Nov 28 00:50:49 user nova-compute[75266]: STATIC:
Nov 28 00:50:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:50:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:50:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:50:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:50:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:50:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:50:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:50:49 user nova-compute[75266]: FIRMWARE:
Nov 28 00:50:49 user nova-compute[75266]: No targets found.
Nov 28 00:50:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:50:49 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:50:49 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4839b65-d254-43b0-9f6e-abdcbeb30b65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3da2a-70b6-4f67-87b1-1817449f8884]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:50:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c33b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde42f6-64f1-4335-9719-8bd9985c6fbe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[47285acc-c144-41ca-8816-6adc8fe2dcfb]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c759a-609e-42d9-80c6-6bee37f81e2b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:50:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f3fb8-cb7d-4f51-b2f2-f9ef86020afd]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e6b5b-a71e-4a51-b2d9-7a23580e1f28]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4e43af-34fd-42a5-bc23-1c8e4ad218f4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:50:50 user nova-compute[75266]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:50:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03bf80-b090-4850-aa2e-0f7d94520670]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== disconnect_volume: return (339ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_resize/disk /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "cp -r /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_resize/disk /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk" returned: 0 in 0.507s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_resize/disk.info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk.info {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "cp -r /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_resize/disk.info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk.info" returned: 0 in 0.040s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:50:51 user nova-compute[75266]: WARNING nova.compute.manager [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state active and task_state resize_migrating.
Nov 28 00:50:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Port 9c1755ff-555e-44fa-8082-fceddb0ee343 binding to destination host user is already ACTIVE {{(pid=75266) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:50:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.utils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d37ab8-7710-483e-b85e-3aea4f5dd364]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02169b2c-cb43-41ba-b4b2-d01d2a81f1a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b0f75-b75d-4792-9ae1-9360692dd47c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7041e-917d-41ef-8e25-8ef4aacd219e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:50:53 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:50:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99bffec-f9e1-49dd-9a64-d83bd647f9af]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:50:53 user nova-compute[75266]: DEBUG os_brick.utils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:50:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:50:58 user nova-compute[75266]: INFO nova.compute.claims [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Claim successful on node user
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:50:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.policy [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:50:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Creating image(s)
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Successfully created port: 1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk 1073741824" returned: 0 in 0.046s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:50:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Cannot resize image /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Ensure instance console log exists: /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Successfully updated port: 1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-changed-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Refreshing instance network info cache due to event network-changed-1137e441-e2d4-4e41-b478-54485b3612f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Acquiring lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Updating instance_info_cache with network_info: [{"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Instance network_info: |[{"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Acquired lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.neutron [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Refreshing network info cache for port 1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Start _get_guest_xml network_info=[{"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:51:00 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:00 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423929614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423929614',id=25,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-2ae948lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:59Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=a5c9b82c-581e-4e29-8d34-286a293a33f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid a5c9b82c-581e-4e29-8d34-286a293a33f9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:51:00 user nova-compute[75266]:   <uuid>a5c9b82c-581e-4e29-8d34-286a293a33f9</uuid>
Nov 28 00:51:00 user nova-compute[75266]:   <name>instance-00000019</name>
Nov 28 00:51:00 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:51:00 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:51:00 user nova-compute[75266]:   <metadata>
Nov 28 00:51:00 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:51:00 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1423929614</nova:name>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:51:00</nova:creationTime>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:51:00 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:51:00 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:owner>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:51:00 user nova-compute[75266]:       </nova:owner>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:51:00 user nova-compute[75266]:       <nova:ports>
Nov 28 00:51:00 user nova-compute[75266]:         <nova:port uuid="1137e441-e2d4-4e41-b478-54485b3612f7">
Nov 28 00:51:00 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 00:51:00 user nova-compute[75266]:         </nova:port>
Nov 28 00:51:00 user nova-compute[75266]:       </nova:ports>
Nov 28 00:51:00 user nova-compute[75266]:     </nova:instance>
Nov 28 00:51:00 user nova-compute[75266]:   </metadata>
Nov 28 00:51:00 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:51:00 user nova-compute[75266]:     <system>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="serial">a5c9b82c-581e-4e29-8d34-286a293a33f9</entry>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="uuid">a5c9b82c-581e-4e29-8d34-286a293a33f9</entry>
Nov 28 00:51:00 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:51:00 user nova-compute[75266]:     </system>
Nov 28 00:51:00 user nova-compute[75266]:   </sysinfo>
Nov 28 00:51:00 user nova-compute[75266]:   <os>
Nov 28 00:51:00 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:51:00 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:51:00 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:51:00 user nova-compute[75266]:   </os>
Nov 28 00:51:00 user nova-compute[75266]:   <features>
Nov 28 00:51:00 user nova-compute[75266]:     <acpi/>
Nov 28 00:51:00 user nova-compute[75266]:     <apic/>
Nov 28 00:51:00 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:51:00 user nova-compute[75266]:   </features>
Nov 28 00:51:00 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:51:00 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:51:00 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:51:00 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:51:00 user nova-compute[75266]:   </clock>
Nov 28 00:51:00 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:51:00 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:51:00 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:51:00 user nova-compute[75266]:   </cpu>
Nov 28 00:51:00 user nova-compute[75266]:   <devices>
Nov 28 00:51:00 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:51:00 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:51:00 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk"/>
Nov 28 00:51:00 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:51:00 user nova-compute[75266]:     </disk>
Nov 28 00:51:00 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:51:00 user nova-compute[75266]:       <mac address="fa:16:3e:5d:68:2d"/>
Nov 28 00:51:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:00 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:51:00 user nova-compute[75266]:       <target dev="tap1137e441-e2"/>
Nov 28 00:51:00 user nova-compute[75266]:     </interface>
Nov 28 00:51:00 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:51:00 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/console.log" append="off"/>
Nov 28 00:51:00 user nova-compute[75266]:     </serial>
Nov 28 00:51:00 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:51:00 user nova-compute[75266]:     <video>
Nov 28 00:51:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:00 user nova-compute[75266]:     </video>
Nov 28 00:51:00 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:51:00 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:51:00 user nova-compute[75266]:     </rng>
Nov 28 00:51:00 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:51:00 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:51:00 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:51:00 user nova-compute[75266]:     </memballoon>
Nov 28 00:51:00 user nova-compute[75266]:   </devices>
Nov 28 00:51:00 user nova-compute[75266]: </domain>
Nov 28 00:51:00 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423929614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423929614',id=25,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-2ae948lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:59Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=a5c9b82c-581e-4e29-8d34-286a293a33f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG os_vif [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdcf98bf-79f7-56c5-b01a-b899c6a16ed7', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1137e441-e2, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1137e441-e2, col_values=(('qos', UUID('a90579bc-0f9b-46d8-99dd-de5b43256318')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1137e441-e2, col_values=(('external_ids', {'iface-id': '1137e441-e2d4-4e41-b478-54485b3612f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:68:2d', 'vm-uuid': 'a5c9b82c-581e-4e29-8d34-286a293a33f9'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: INFO os_vif [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2')
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:5d:68:2d, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:01 user nova-compute[75266]: INFO nova.compute.manager [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Terminating instance
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Updated VIF entry in instance network info cache for port 1137e441-e2d4-4e41-b478-54485b3612f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Updating instance_info_cache with network_info: [{"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Releasing lock "refresh_cache-a5c9b82c-581e-4e29-8d34-286a293a33f9" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Starting finish_migration {{(pid=75266) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:51:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Creating image(s)
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk. size=21474836480 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:51:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk 21474836480 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk 21474836480" returned: 0 in 0.054s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Ensure instance console log exists: /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start _get_guest_xml network_info=[{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '41828b32-f570-4428-8064-5c199a898a04', 'attached_at': '2023-11-28T00:51:02.000000', 'detached_at': '', 'volume_id': '307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'serial': '307a1ca3-5fc8-4700-849a-6b2cbcacd748'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e03bc37b-f6a2-4a45-8a27-e12581ce0066', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:51:02 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:02 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:02 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[36305483-6cad-4fc5-b59d-b392d71363e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:51:02 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78fe0cb-cae7-4fa6-85e2-84ee5a3af421]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[419bd816-4211-4902-bf85-3aee5ee0d835]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Instance destroyed successfully.
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'resources' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1551649898',display_name='tempest-ServerActionsTestOtherA-server-622494469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1551649898',id=15,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q==',key_name='tempest-keypair-1264480328',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:47:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-y0oyoxi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=ccbf5fa2-6207-49fd-9cca-127fb0358d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "85cfd155-656c-4678-9381-9603640b1bd4", "address": "fa:16:3e:60:ee:42", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cfd155-65", "ovs_interfaceid": "85cfd155-656c-4678-9381-9603640b1bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_vif [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b20837-d10f-4d9f-aa52-f7b6406cdf7f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event volume-reimaged-c2b4dff1-92b2-4410-a861-a1efbadb6787 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Processing event volume-reimaged-c2b4dff1-92b2-4410-a861-a1efbadb6787 {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85cfd155-65, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d52837b-505a-4fd5-940d-ddf616a432e1) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4772b-cae3-4f3a-bd01-1c7135fa90b4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: INFO os_vif [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:ee:42,bridge_name='br-int',has_traffic_filtering=True,id=85cfd155-656c-4678-9381-9603640b1bd4,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cfd155-65')
Nov 28 00:51:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Deleting instance files /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08_del
Nov 28 00:51:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Deletion of /opt/stack/data/nova/instances/ccbf5fa2-6207-49fd-9cca-127fb0358d08_del complete
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGKstYvH'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0c09f-d632-4d78-ac96-1c0bb3511352]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: INFO nova.virt.block_device [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Booting with volume c2b4dff1-92b2-4410-a861-a1efbadb6787 at /dev/vda
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cd270-5e72-4095-985e-55c65c1e0832]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: INFO nova.compute.manager [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3628ff88-3da9-4e0f-949f-e762a4be2834]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:51:02 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0154e-8c37-416f-8ce8-9e14576c93ac]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf7d6a9-5a33-4e25-a837-7c047eaf999c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf8238-3e39-4830-997c-523245126187]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[622810e5-cba1-497c-b3d0-fdf588fd47ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[672fe037-a920-4639-abdf-869ed31e8f42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6b43f-c403-4d29-90e0-2e78704bdce2]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46f9a62-e3a2-4a45-a3d7-a7e88569625d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:02 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:51:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa902a-06fb-46d5-9199-e9d9f869bcf8]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating existing volume attachment record: e3cb6029-2e59-47a1-ad40-8b40d23885dd {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-deleted-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: INFO nova.compute.manager [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Neutron deleted interface 85cfd155-656c-4678-9381-9603640b1bd4; detaching it from the instance and deleting it from the info cache
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.neutron [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:03 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Took 0.73 seconds to deallocate network for instance.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Detach interface failed, port_id=85cfd155-656c-4678-9381-9603640b1bd4, reason: Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state deleted and task_state None.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state deleted and task_state None.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state deleted and task_state None.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-unplugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state deleted and task_state None.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] No waiting events found dispatching network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Received unexpected event network-vif-plugged-85cfd155-656c-4678-9381-9603640b1bd4 for instance with vm_state deleted and task_state None.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] No waiting events found dispatching network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received unexpected event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 for instance with vm_state building and task_state spawning.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] No waiting events found dispatching network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:03 user nova-compute[75266]: WARNING nova.compute.manager [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received unexpected event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 for instance with vm_state building and task_state spawning.
Nov 28 00:51:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:51:03 user nova-compute[75266]:   <uuid>41828b32-f570-4428-8064-5c199a898a04</uuid>
Nov 28 00:51:03 user nova-compute[75266]:   <name>instance-00000012</name>
Nov 28 00:51:03 user nova-compute[75266]:   <memory>2097152</memory>
Nov 28 00:51:03 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:51:03 user nova-compute[75266]:   <metadata>
Nov 28 00:51:03 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:51:03 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherB-server-1577106707</nova:name>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:51:02</nova:creationTime>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:flavor name="m1.small">
Nov 28 00:51:03 user nova-compute[75266]:         <nova:memory>2048</nova:memory>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:disk>20</nova:disk>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:51:03 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:owner>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:user uuid="e626332697e34a0ba733c723a5ecb328">tempest-ServerActionsTestOtherB-1824523225-project-member</nova:user>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:project uuid="b57f21cfce3044c5aad7192a64ce2d8a">tempest-ServerActionsTestOtherB-1824523225</nova:project>
Nov 28 00:51:03 user nova-compute[75266]:       </nova:owner>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:51:03 user nova-compute[75266]:       <nova:ports>
Nov 28 00:51:03 user nova-compute[75266]:         <nova:port uuid="9c1755ff-555e-44fa-8082-fceddb0ee343">
Nov 28 00:51:03 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:51:03 user nova-compute[75266]:         </nova:port>
Nov 28 00:51:03 user nova-compute[75266]:       </nova:ports>
Nov 28 00:51:03 user nova-compute[75266]:     </nova:instance>
Nov 28 00:51:03 user nova-compute[75266]:   </metadata>
Nov 28 00:51:03 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:51:03 user nova-compute[75266]:     <system>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="serial">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="uuid">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:51:03 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:51:03 user nova-compute[75266]:     </system>
Nov 28 00:51:03 user nova-compute[75266]:   </sysinfo>
Nov 28 00:51:03 user nova-compute[75266]:   <os>
Nov 28 00:51:03 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:51:03 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:51:03 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:51:03 user nova-compute[75266]:   </os>
Nov 28 00:51:03 user nova-compute[75266]:   <features>
Nov 28 00:51:03 user nova-compute[75266]:     <acpi/>
Nov 28 00:51:03 user nova-compute[75266]:     <apic/>
Nov 28 00:51:03 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:51:03 user nova-compute[75266]:   </features>
Nov 28 00:51:03 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:51:03 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:51:03 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:51:03 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:51:03 user nova-compute[75266]:   </clock>
Nov 28 00:51:03 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:51:03 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:51:03 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:51:03 user nova-compute[75266]:   </cpu>
Nov 28 00:51:03 user nova-compute[75266]:   <devices>
Nov 28 00:51:03 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:51:03 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:51:03 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk"/>
Nov 28 00:51:03 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:51:03 user nova-compute[75266]:     </disk>
Nov 28 00:51:03 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:51:03 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:03 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:51:03 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:51:03 user nova-compute[75266]:       <serial>307a1ca3-5fc8-4700-849a-6b2cbcacd748</serial>
Nov 28 00:51:03 user nova-compute[75266]:     </disk>
Nov 28 00:51:03 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:51:03 user nova-compute[75266]:       <mac address="fa:16:3e:e3:c0:e9"/>
Nov 28 00:51:03 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:03 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:51:03 user nova-compute[75266]:       <target dev="tap9c1755ff-55"/>
Nov 28 00:51:03 user nova-compute[75266]:     </interface>
Nov 28 00:51:03 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:51:03 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/console.log" append="off"/>
Nov 28 00:51:03 user nova-compute[75266]:     </serial>
Nov 28 00:51:03 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:51:03 user nova-compute[75266]:     <video>
Nov 28 00:51:03 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:03 user nova-compute[75266]:     </video>
Nov 28 00:51:03 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:51:03 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:51:03 user nova-compute[75266]:     </rng>
Nov 28 00:51:03 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:51:03 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:51:03 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:51:03 user nova-compute[75266]:     </memballoon>
Nov 28 00:51:03 user nova-compute[75266]:   </devices>
Nov 28 00:51:03 user nova-compute[75266]: </domain>
Nov 28 00:51:03 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-208434077-network", "vif_mac": "fa:16:3e:e3:c0:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG os_vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96741050-df23-5933-82ff-a74e70923eb3', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1755ff-55, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1755ff-55, col_values=(('qos', UUID('8f352509-981d-4699-aa39-2bafc5930273')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1755ff-55, col_values=(('external_ids', {'iface-id': '9c1755ff-555e-44fa-8082-fceddb0ee343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:c0:e9', 'vm-uuid': '41828b32-f570-4428-8064-5c199a898a04'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:03 user nova-compute[75266]: INFO os_vif [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] No VIF found with MAC fa:16:3e:e3:c0:e9, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:51:03 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Deleted allocations for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08
Nov 28 00:51:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "ccbf5fa2-6207-49fd-9cca-127fb0358d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.834s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:51:05 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Instance spawned successfully.
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: INFO nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: INFO nova.compute.manager [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Took 6.62 seconds to build instance.
Nov 28 00:51:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:05 user nova-compute[75266]: WARNING nova.compute.manager [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state active and task_state resize_finish.
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:07 user nova-compute[75266]: WARNING nova.compute.manager [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state active and task_state resize_finish.
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:51:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance running successfully.
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Failed to set time: agent not configured {{(pid=75266) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] finish_migration finished successfully. {{(pid=75266) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:07 user nova-compute[75266]: INFO nova.compute.manager [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attaching volume 8d360377-702a-4b82-92ec-8ab269539773 to /dev/vdb
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b64600e-3354-408b-9ee9-7c682d7f73dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bcfad1-65ce-4ffe-a7ee-ff5430cf0263]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27ec692-19af-4f9e-adb7-32e6e6c64f79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f050c7-fa2b-473c-bfef-86cbbea7b865]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:08 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:51:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c91e8a2-59d3-469f-8c2f-7f41220ed149]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating existing volume attachment record: 8770fa8d-d461-45b9-963c-5360adb6aeef {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:51:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:51:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Creating image(s)
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Ensure instance console log exists: /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start _get_guest_xml network_info=[{"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72e2c36d-6ae4-4af8-8511-5d36532b76e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2b4dff1-92b2-4410-a861-a1efbadb6787', 'serial': 'c2b4dff1-92b2-4410-a861-a1efbadb6787'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e3cb6029-2e59-47a1-ad40-8b40d23885dd', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:51:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 00:51:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.objects.instance [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lazy-loading 'vcpu_model' on Instance uuid 72e2c36d-6ae4-4af8-8511-5d36532b76e0 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:10 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2838c-2aae-4e54-8c70-24ef0b617d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:51:10 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdedcf8d-4be3-48e9-9b89-13ceae7136d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787] added
Nov 28 00:51:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da9fe64-391c-4939-a31b-5c302dabf199]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae61553-001f-465f-9a33-1259f183736a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySbBoxIA {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySbBoxIA" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f943b1-0740-47a7-b5bc-4fce4ea75b5a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySbBoxIA'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec684379-91bc-4be8-abff-3d6023643cc4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5878c4-8402-46f0-ad35-2b98503ca5e8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[41555ad6-1db3-446c-9b20-f4c1aa093f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]
Nov 28 00:51:11 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c4cd9b-e973-43cb-86a3-5aa198c26946]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef520615-df62-487d-b81d-fe616d0ffc52]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc50b9-92de-4e0e-83e2-e3579a160927]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:51:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23365666132303539', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365666132303539', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935386610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:51:12 user nova-compute[75266]:   <uuid>72e2c36d-6ae4-4af8-8511-5d36532b76e0</uuid>
Nov 28 00:51:12 user nova-compute[75266]:   <name>instance-00000015</name>
Nov 28 00:51:12 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:51:12 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:51:12 user nova-compute[75266]:   <metadata>
Nov 28 00:51:12 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:51:12 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:51:12 user nova-compute[75266]:       <nova:name>tempest-ServerActionsV293TestJSON-server-935386610</nova:name>
Nov 28 00:51:12 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:51:10</nova:creationTime>
Nov 28 00:51:12 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:51:12 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:51:12 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:51:12 user nova-compute[75266]:       <nova:owner>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:user uuid="9549789f88df42959b0e1ecce3619f8b">tempest-ServerActionsV293TestJSON-1839048538-project-member</nova:user>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:project uuid="4ea5483b85d845699f0431b1cf8f6c7f">tempest-ServerActionsV293TestJSON-1839048538</nova:project>
Nov 28 00:51:12 user nova-compute[75266]:       </nova:owner>
Nov 28 00:51:12 user nova-compute[75266]:       <nova:ports>
Nov 28 00:51:12 user nova-compute[75266]:         <nova:port uuid="2d3f6903-a024-4928-afba-ce8273784c3e">
Nov 28 00:51:12 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 00:51:12 user nova-compute[75266]:         </nova:port>
Nov 28 00:51:12 user nova-compute[75266]:       </nova:ports>
Nov 28 00:51:12 user nova-compute[75266]:     </nova:instance>
Nov 28 00:51:12 user nova-compute[75266]:   </metadata>
Nov 28 00:51:12 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:51:12 user nova-compute[75266]:     <system>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="serial">72e2c36d-6ae4-4af8-8511-5d36532b76e0</entry>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="uuid">72e2c36d-6ae4-4af8-8511-5d36532b76e0</entry>
Nov 28 00:51:12 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:51:12 user nova-compute[75266]:     </system>
Nov 28 00:51:12 user nova-compute[75266]:   </sysinfo>
Nov 28 00:51:12 user nova-compute[75266]:   <os>
Nov 28 00:51:12 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:51:12 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:51:12 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:51:12 user nova-compute[75266]:   </os>
Nov 28 00:51:12 user nova-compute[75266]:   <features>
Nov 28 00:51:12 user nova-compute[75266]:     <acpi/>
Nov 28 00:51:12 user nova-compute[75266]:     <apic/>
Nov 28 00:51:12 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:51:12 user nova-compute[75266]:   </features>
Nov 28 00:51:12 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:51:12 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:51:12 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:51:12 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:51:12 user nova-compute[75266]:   </clock>
Nov 28 00:51:12 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:51:12 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:51:12 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:51:12 user nova-compute[75266]:   </cpu>
Nov 28 00:51:12 user nova-compute[75266]:   <devices>
Nov 28 00:51:12 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:51:12 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:12 user nova-compute[75266]:       <source dev="/dev/sde"/>
Nov 28 00:51:12 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:51:12 user nova-compute[75266]:       <serial>c2b4dff1-92b2-4410-a861-a1efbadb6787</serial>
Nov 28 00:51:12 user nova-compute[75266]:     </disk>
Nov 28 00:51:12 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:51:12 user nova-compute[75266]:       <mac address="fa:16:3e:bd:91:a4"/>
Nov 28 00:51:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:12 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:51:12 user nova-compute[75266]:       <target dev="tap2d3f6903-a0"/>
Nov 28 00:51:12 user nova-compute[75266]:     </interface>
Nov 28 00:51:12 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:51:12 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0/console.log" append="off"/>
Nov 28 00:51:12 user nova-compute[75266]:     </serial>
Nov 28 00:51:12 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:51:12 user nova-compute[75266]:     <video>
Nov 28 00:51:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:51:12 user nova-compute[75266]:     </video>
Nov 28 00:51:12 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:51:12 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:51:12 user nova-compute[75266]:     </rng>
Nov 28 00:51:12 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:51:12 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:51:12 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:51:12 user nova-compute[75266]:     </memballoon>
Nov 28 00:51:12 user nova-compute[75266]:   </devices>
Nov 28 00:51:12 user nova-compute[75266]: </domain>
Nov 28 00:51:12 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935386610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG os_vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9e3b97a-c132-5b95-bbae-1f0a8e0a1824', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3f6903-a0, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d3f6903-a0, col_values=(('qos', UUID('731c0758-b138-492b-b2b1-c4dd20ac0071')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d3f6903-a0, col_values=(('external_ids', {'iface-id': '2d3f6903-a024-4928-afba-ce8273784c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:91:a4', 'vm-uuid': '72e2c36d-6ae4-4af8-8511-5d36532b76e0'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:12 user nova-compute[75266]: INFO os_vif [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0')
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] No VIF found with MAC fa:16:3e:bd:91:a4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:13 user nova-compute[75266]: WARNING nova.compute.manager [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state active and task_state rebuild_spawning.
Nov 28 00:51:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:15 user nova-compute[75266]: WARNING nova.compute.manager [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state active and task_state rebuild_spawning.
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaTifrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:16 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73305d8-f080-43ea-997f-468aff422353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:51:16 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:51:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance spawned successfully.
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[785378e6-38df-48a2-bdc2-223ed7611cbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773] added
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[107983b0-003c-4d94-bd97-71295136ab53]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bacd0-1c38-4198-8e22-f7b9ad502a34]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jaTifrOn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jaTifrOn" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32967d-579c-41e8-b3a2-b35559a733a7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jaTifrOn'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de985473-e6c3-4335-a39a-5bb471379c0d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb9b07b-37aa-48e9-81b5-3c1cce9bf8e1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG nova.objects.instance [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75266) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[333976da-3817-4bba-975a-0023fe4ddaa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260]
Nov 28 00:51:16 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca19c3a-7492-4a81-8e50-5195f3c1d8be]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c157bc-98f3-4bc6-befa-34db694ddfae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d06b3a-d0bc-4edd-be4d-989655de3c80]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaTifrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23061343261386333', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061343261386333', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:51:17 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:17 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:51:17 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:51:17 user nova-compute[75266]:   <serial>8d360377-702a-4b82-92ec-8ab269539773</serial>
Nov 28 00:51:17 user nova-compute[75266]: </disk>
Nov 28 00:51:17 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No VIF found with MAC fa:16:3e:d1:c0:61, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:51:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.057s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:18 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:51:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:20 user nova-compute[75266]: INFO nova.compute.manager [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Detaching volume 8d360377-702a-4b82-92ec-8ab269539773
Nov 28 00:51:20 user nova-compute[75266]: INFO nova.compute.manager [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Terminating instance
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:20 user nova-compute[75266]: INFO nova.virt.block_device [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attempting to driver detach volume 8d360377-702a-4b82-92ec-8ab269539773 from mountpoint /dev/vdb
Nov 28 00:51:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Attempting to detach device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:51:20 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:20 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:51:20 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:51:20 user nova-compute[75266]:   <serial>8d360377-702a-4b82-92ec-8ab269539773</serial>
Nov 28 00:51:20 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:51:20 user nova-compute[75266]: </disk>
Nov 28 00:51:20 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:51:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config.
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:51:20 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:20 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:51:20 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:51:20 user nova-compute[75266]:   <serial>8d360377-702a-4b82-92ec-8ab269539773</serial>
Nov 28 00:51:20 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:51:20 user nova-compute[75266]: </disk>
Nov 28 00:51:20 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-unplugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Instance destroyed successfully.
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'resources' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1318610697',display_name='tempest-AttachVolumeTestJSON-server-1318610697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1318610697',id=1,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg==',key_name='tempest-keypair-818574112',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-aiu2o3uj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=6f7c5378-aadc-45e4-b3c3-d308e526b03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "address": "fa:16:3e:6b:f5:56", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598b9806-e5", "ovs_interfaceid": "598b9806-e561-4d8b-9e33-1e8ec1268b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG os_vif [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598b9806-e5, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aa2d48f-5c01-4edf-bfda-cd9c97790003) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:21 user nova-compute[75266]: INFO os_vif [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:f5:56,bridge_name='br-int',has_traffic_filtering=True,id=598b9806-e561-4d8b-9e33-1e8ec1268b48,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598b9806-e5')
Nov 28 00:51:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Deleting instance files /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a_del
Nov 28 00:51:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Deletion of /opt/stack/data/nova/instances/6f7c5378-aadc-45e4-b3c3-d308e526b03a_del complete
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:21 user nova-compute[75266]: INFO nova.compute.manager [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:22 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Took 0.91 seconds to deallocate network for instance.
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-deleted-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:22 user nova-compute[75266]: INFO nova.compute.manager [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Neutron deleted interface 598b9806-e561-4d8b-9e33-1e8ec1268b48; detaching it from the instance and deleting it from the info cache
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Detach interface failed, port_id=598b9806-e561-4d8b-9e33-1e8ec1268b48, reason: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '6f7c5378-aadc-45e4-b3c3-d308e526b03a' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '6f7c5378-aadc-45e4-b3c3-d308e526b03a' (instance-00000001)
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Acquiring lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] No waiting events found dispatching network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:22 user nova-compute[75266]: WARNING nova.compute.manager [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Received unexpected event network-vif-plugged-598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance with vm_state deleted and task_state None.
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:23 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Deleted allocations for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "6f7c5378-aadc-45e4-b3c3-d308e526b03a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:51:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7187MB free_disk=25.154918670654297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Applying migration context for instance 41828b32-f570-4428-8064-5c199a898a04 as it has an incoming, in-progress migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3. Migration status is finished {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 00:51:24 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating resource usage from migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:51:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:26 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:51:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:51:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-changed-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing instance network info cache due to event network-changed-6d244ad1-2ec1-403c-a79a-fc55601d3713. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:51:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Acquiring lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Acquired lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Refreshing network info cache for port 6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:51:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updated VIF entry in instance network info cache for port 6d244ad1-2ec1-403c-a79a-fc55601d3713. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:51:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Releasing lock "refresh_cache-f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:51:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:36 user nova-compute[75266]: INFO nova.compute.manager [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Terminating instance
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-142e2086-37d6-40f3-a928-4989daf67ba9 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Instance destroyed successfully.
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.objects.instance [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lazy-loading 'resources' on Instance uuid f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d244ad1-2e, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca52bd48-cb15-4583-b999-0a793585ea46) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ec:53,bridge_name='br-int',has_traffic_filtering=True,id=6d244ad1-2ec1-403c-a79a-fc55601d3713,network=Network(d84b4039-6017-467c-b5de-f0b63819bff1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d244ad1-2e')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc96774b3-2a, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5eb76b4-ebaa-4085-b59d-21365f5463f1) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:2e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c96774b3-2a86-4fae-9733-45e0dc0f4f49,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc96774b3-2a')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6c26ecd-15, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29ad856b-b4bf-450f-bece-a6f201234e3e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6c26ecd-15')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c25b79e-79, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f14d3b7b-7051-4440-a4fd-69ebc6c75e24) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:cd:22,bridge_name='br-int',has_traffic_filtering=True,id=4c25b79e-79ff-420f-bdd9-9392bd703156,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c25b79e-79')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap142e2086-37, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e39911e6-cce9-4674-bb0a-1160210c44e7) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f1:72,bridge_name='br-int',has_traffic_filtering=True,id=142e2086-37d6-40f3-a928-4989daf67ba9,network=Network(42b0b18b-0fff-44ce-9e07-b271761d0f78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap142e2086-37')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap286b6758-a4, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9232cbd-7a71-4fba-8d4a-71ca0293566c) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=286b6758-a4bb-46ee-8766-d16fff0e3b25,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b6758-a4')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T00:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211957985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-211957985',id=22,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw==',key_name='tempest-keypair-818529533',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4944a899309047f9979213a267d79dc4',ramdisk_id='',reservation_id='r-zs2r0dht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-813468473',owner_user_name='tempest-TaggedBootDevicesTest_v242-813468473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a3f3d233d494eedb5263da5485c8271',uuid=f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converting VIF {"id": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "address": "fa:16:3e:97:63:a7", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e01d3b-dc", "ovs_interfaceid": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49e01d3b-dc, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05c36069-1d6b-4e84-a1c8-b99276b2bd99) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:38 user nova-compute[75266]: INFO os_vif [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:63:a7,bridge_name='br-int',has_traffic_filtering=True,id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210,network=Network(6c8e7691-0880-4017-be6a-7080e0941f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e01d3b-dc')
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCBxczyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:38 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75420b8-5441-43f1-9758-63d3b2c9db30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:51:38 user nova-compute[75266]: No targets found.
Nov 28 00:51:38 user nova-compute[75266]: iSNS:
Nov 28 00:51:38 user nova-compute[75266]: No targets found.
Nov 28 00:51:38 user nova-compute[75266]: STATIC:
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:51:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:38 user nova-compute[75266]: FIRMWARE:
Nov 28 00:51:38 user nova-compute[75266]: No targets found.
Nov 28 00:51:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:51:38 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:51:38 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec54de7-81ca-4fd0-8f4f-2ea3c67c2874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef210bb6-b062-40ec-a5f6-71af33835ae0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada3b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e258b4e-94e1-48e9-be71-ad8ce888cf84]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe05b2-8f17-4867-901c-e4c064e0ca0b]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdce180-2ba7-4121-a2d3-ad74182f82c2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a2c5b-ffb7-4048-9dc7-c0f1f8873184]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d3645-6811-4379-805a-1985ee7231ef]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:38 user nova-compute[75266]: WARNING nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance with vm_state active and task_state deleting.
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:38 user nova-compute[75266]: WARNING nova.compute.manager [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance with vm_state active and task_state deleting.
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e128ee0-5c30-43e5-8fa5-381604c1a8d1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260]
Nov 28 00:51:38 user nova-compute[75266]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6937f5b-e643-48c5-9a70-2ff88d4e5f2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[833fbf8e-230b-48fd-9ca8-7b008ce23d67]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== disconnect_volume: return (357ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZKdhQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:38 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf471298-e223-43c4-9b68-7fe198008f94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance with vm_state active and task_state deleting.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-4c25b79e-79ff-420f-bdd9-9392bd703156 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-4c25b79e-79ff-420f-bdd9-9392bd703156 for instance with vm_state active and task_state deleting.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING nova.compute.manager [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance with vm_state active and task_state deleting.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]: iSNS:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]: STATIC:
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:51:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:51:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da1845c-cb7a-428b-9be0-2bebe8692b5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[33000744-3469-4274-ad3a-ca335a788c68]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada3a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7684d242-19ac-45f2-ac51-906503de4db2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b753df-dd5e-448f-8dc7-f4e730ab8d45]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb44fc5-3743-4f5e-8530-b150dcf65180]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80569cfd-767b-4b8f-abb3-3eef7456942e]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-142e2086-37d6-40f3-a928-4989daf67ba9 for instance with vm_state active and task_state deleting.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-unplugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-unplugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Acquiring lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] No waiting events found dispatching network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING nova.compute.manager [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received unexpected event network-vif-plugged-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance with vm_state active and task_state deleting.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b3d533-4e73-4ccf-99de-e7c85bde3f4d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[12039416-2240-434a-8f73-7f99e0e9b74f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260]
Nov 28 00:51:39 user nova-compute[75266]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: INFO nova.compute.manager [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Terminating instance
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce85e62-5265-44e8-ae95-426ad618a9cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[39681e4b-8315-4ecb-97f0-ff659f71edc8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== disconnect_volume: return (382ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvkGYsah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c14f2df-007a-45ba-8a02-18e46dc71142]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]: iSNS:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]: STATIC:
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:51:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:51:39 user nova-compute[75266]: No targets found.
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:51:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:51:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80509d78-e731-4eb0-8f12-c86e9646171d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[07188a73-9453-4a67-8dad-13ca2881d058]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c59f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711'): ({'sdh'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Removing single pathed devices sdh {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f3b2e-5ae5-4f4e-9b2b-0b3904bb5c6f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb1905a-fd1c-4867-9b8e-de48f9580b3d]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flushing IO for device /dev/sdh {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.011s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fed5b3-6224-4006-9ad3-c036a7b9ba06]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e32ee2a-f65c-478f-953e-393b02fca089]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b95ea-9075-41c9-a7fd-e78dab2243dd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c85556-7467-4136-a711-ee2e3a21877b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260]
Nov 28 00:51:39 user nova-compute[75266]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc842d4-89dc-4631-b51f-18f57c6d8711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[095dc836-237f-432e-b521-3729db8c5c78]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] <== disconnect_volume: return (353ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:51:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Deleting instance files /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3_del
Nov 28 00:51:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Deletion of /opt/stack/data/nova/instances/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3_del complete
Nov 28 00:51:39 user nova-compute[75266]: INFO nova.compute.manager [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Took 3.47 seconds to destroy the instance on the hypervisor.
Nov 28 00:51:39 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:51:39 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:51:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Instance destroyed successfully.
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.objects.instance [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lazy-loading 'resources' on Instance uuid 04175bce-9dc6-432e-8c06-e55f4e2aeb65 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-10295081',display_name='tempest-VolumesActionsTest-instance-10295081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-10295081',id=23,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dfd77666ef94a61b16d07a624036091',ramdisk_id='',reservation_id='r-kt2ig09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1457578131',owner_user_name='tempest-VolumesActionsTest-1457578131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:49:55Z,user_data=None,user_id='f1d154145c6944a790da943c75adb000',uuid=04175bce-9dc6-432e-8c06-e55f4e2aeb65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converting VIF {"id": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "address": "fa:16:3e:b0:ca:1e", "network": {"id": "4f7cdbae-2a41-4a0e-8669-d9665014c684", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1826100417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dfd77666ef94a61b16d07a624036091", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fb14075-40", "ovs_interfaceid": "6fb14075-40d0-488e-86ee-32b1d5ce7c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG os_vif [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fb14075-40, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70a82c3c-ac1b-4faa-9835-f970ced1507c) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:40 user nova-compute[75266]: INFO os_vif [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:ca:1e,bridge_name='br-int',has_traffic_filtering=True,id=6fb14075-40d0-488e-86ee-32b1d5ce7c20,network=Network(4f7cdbae-2a41-4a0e-8669-d9665014c684),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fb14075-40')
Nov 28 00:51:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Deleting instance files /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65_del
Nov 28 00:51:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Deletion of /opt/stack/data/nova/instances/04175bce-9dc6-432e-8c06-e55f4e2aeb65_del complete
Nov 28 00:51:40 user nova-compute[75266]: INFO nova.compute.manager [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 00:51:40 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:40 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Took 0.49 seconds to deallocate network for instance.
Nov 28 00:51:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-vif-deleted-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:41 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 is timed out.
Nov 28 00:51:41 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config.
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaTifrOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:41 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7e4400-85ad-410c-96ed-cef8651d0da6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:51:41 user nova-compute[75266]: No targets found.
Nov 28 00:51:41 user nova-compute[75266]: iSNS:
Nov 28 00:51:41 user nova-compute[75266]: No targets found.
Nov 28 00:51:41 user nova-compute[75266]: STATIC:
Nov 28 00:51:41 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:51:41 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:41 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:41 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:51:41 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:41 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:41 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773
Nov 28 00:51:41 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:41 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:41 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:51:41 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:51:41 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:51:41 user nova-compute[75266]: FIRMWARE:
Nov 28 00:51:41 user nova-compute[75266]: No targets found.
Nov 28 00:51:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:51:41 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:51:41 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[90582454-ab7b-42f6-a98d-9fd717a0819c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-vif-unplugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] No waiting events found dispatching network-vif-unplugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:41 user nova-compute[75266]: WARNING nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received unexpected event network-vif-unplugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance with vm_state deleted and task_state None.
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Acquiring lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] No waiting events found dispatching network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:51:41 user nova-compute[75266]: WARNING nova.compute.manager [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Received unexpected event network-vif-plugged-6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance with vm_state deleted and task_state None.
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8630c0-1fd5-43f0-9ce6-56302f9f80e6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 (non-flash)
Nov 28 00:51:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c3e09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Deleted allocations for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21bbbb-2f3a-4737-acf3-b75089988819]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b9345-dead-4d9c-a86c-2e8aabe77594]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab12e8e-f330-4c2c-9366-4a325c7601a8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[492226f4-e012-4097-8e4f-48e0cab2b779]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79dcd81-791d-4a2e-ae6a-d03a0f2d5ba0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "04175bce-9dc6-432e-8c06-e55f4e2aeb65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-deleted-49e01d3b-dcb9-4186-bba1-8afe6a8ac210 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:41 user nova-compute[75266]: INFO nova.compute.manager [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Neutron deleted interface 49e01d3b-dcb9-4186-bba1-8afe6a8ac210; detaching it from the instance and deleting it from the info cache
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [{"id": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "address": "fa:16:3e:5f:ec:53", "network": {"id": "d84b4039-6017-467c-b5de-f0b63819bff1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-582288259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d244ad1-2e", "ovs_interfaceid": "6d244ad1-2ec1-403c-a79a-fc55601d3713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "address": "fa:16:3e:2f:2e:2c", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96774b3-2a", "ovs_interfaceid": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "address": "fa:16:3e:f1:2c:02", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6c26ecd-15", "ovs_interfaceid": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c25b79e-79ff-420f-bdd9-9392bd703156", "address": "fa:16:3e:25:cd:22", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c25b79e-79", "ovs_interfaceid": "4c25b79e-79ff-420f-bdd9-9392bd703156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "142e2086-37d6-40f3-a928-4989daf67ba9", "address": "fa:16:3e:ec:f1:72", "network": {"id": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "bridge": "br-int", "label": "tempest-device-tagging-net1-60980290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap142e2086-37", "ovs_interfaceid": "142e2086-37d6-40f3-a928-4989daf67ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "address": "fa:16:3e:56:b6:cb", "network": {"id": "6c8e7691-0880-4017-be6a-7080e0941f38", "bridge": "br-int", "label": "tempest-device-tagging-net2-1435523769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4944a899309047f9979213a267d79dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b6758-a4", "ovs_interfaceid": "286b6758-a4bb-46ee-8766-d16fff0e3b25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b83550-acfe-4e9a-b398-a5576a206863]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260]
Nov 28 00:51:41 user nova-compute[75266]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Detach interface failed, port_id=49e01d3b-dcb9-4186-bba1-8afe6a8ac210, reason: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d360377-702a-4b82-92ec-8ab269539773 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9935f745-8d0d-46e8-b3f7-4f2a02d89038]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== disconnect_volume: return (366ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:51:42 user nova-compute[75266]: DEBUG nova.objects.instance [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.926s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:43 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:43 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Took 3.59 seconds to deallocate network for instance.
Nov 28 00:51:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-deleted-286b6758-a4bb-46ee-8766-d16fff0e3b25 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-deleted-142e2086-37d6-40f3-a928-4989daf67ba9 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-deleted-6d244ad1-2ec1-403c-a79a-fc55601d3713 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Received event network-vif-deleted-4c25b79e-79ff-420f-bdd9-9392bd703156 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:45 user nova-compute[75266]: INFO nova.compute.manager [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Took 2.30 seconds to detach 3 volumes for instance.
Nov 28 00:51:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:46 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:51:46 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:51:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:46 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Deleted allocations for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3
Nov 28 00:51:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.885s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-changed-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing instance network info cache due to event network-changed-2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG nova.network.neutron [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:51:50 user nova-compute[75266]: INFO nova.compute.manager [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Attaching volume 685d49b1-0ae7-4bd5-8960-edfa41570827 to /dev/vdb
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.utils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[48603ce2-08cb-4da4-b883-99c294f91bc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630cf57-8ff3-4e98-9a03-30954d9666ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG nova.network.neutron [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updated VIF entry in instance network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG nova.network.neutron [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a669f4-372d-4cd9-ae8a-84367c8be7f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e75981-d96c-4419-80cf-c45c651d5904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:51:50 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:51:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785e998-9a51-4723-96e7-0f496662fe62]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG os_brick.utils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating existing volume attachment record: b204a39b-e56a-46cc-99b7-cbcbae7af2de {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:51:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEMngzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:51:56 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:56 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:51:56 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:51:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00a019-4b5b-4b1f-81d9-b9089a43376b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:51:56 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4fe905-4b22-475b-8f95-8ac76835270b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827] added
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c831f6-554c-4c64-99d5-1d8c5478d076]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c0729-f532-4f8b-b6e3-6b4182b01968]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKEMngzc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKEMngzc" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[454668f1-7143-493a-b9ac-a122a448fc4f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKEMngzc'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95df34a-6bf5-470a-af2d-dd18088c97a5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[782be90a-f551-4df7-8f92-a6982fe04c29]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf05477-c4e1-40ec-ada5-4683741d195a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260]
Nov 28 00:51:57 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260] successful.
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2e849-83bc-43bc-974d-6717f79be056]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7935103-e7ec-487d-be98-ed4caa09257e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:51:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[899a8298-dfb3-473e-a9b6-97d5ab5ec48b]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:51:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEMngzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23434306332306437', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434306332306437', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:51:58 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:51:58 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:51:58 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:51:58 user nova-compute[75266]:   <serial>685d49b1-0ae7-4bd5-8960-edfa41570827</serial>
Nov 28 00:51:58 user nova-compute[75266]: </disk>
Nov 28 00:51:58 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:74:a5:a8, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:51:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.747s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:51:59 user nova-compute[75266]: INFO nova.compute.manager [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Rescuing
Nov 28 00:51:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:51:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:51:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:00 user nova-compute[75266]: WARNING nova.compute.manager [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state active and task_state rescuing.
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance destroyed successfully.
Nov 28 00:52:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Attempting rescue
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:52:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Creating image(s)
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'trusted_certs' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue" returned: 0 in 0.052s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'migration_context' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<a835216a-04a1-4660-a458-13cca79489c3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start _get_guest_xml network_info=[{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:74:a5:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<a835216a-04a1-4660-a458-13cca79489c3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'numa_topology' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<a835216a-04a1-4660-a458-13cca79489c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'vcpu_model' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<a835216a-04a1-4660-a458-13cca79489c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1287657777',display_name='tempest-ServerRescueNegativeTestJSON-server-1287657777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1287657777',id=24,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbgL6uxmLC3MZN+RrqUPtpw5FpUn8maTx0Cf4LCwQCRvDd2+IMQRtiAJBB/3y8VPHozvUpRK0AlMQnI/+Jt36ZBNau3gnhdcxDotPvQEvFguuKb5CmCFRaaKSD+AGTLA==',key_name='tempest-keypair-986818562',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-tlhozz48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad5a4c6583f42b39eda624923ded77b',uuid=a835216a-04a1-4660-a458-13cca79489c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:74:a5:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "vif_mac": "fa:16:3e:74:a5:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'pci_devices' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Object Instance<a835216a-04a1-4660-a458-13cca79489c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:52:01 user nova-compute[75266]:   <uuid>a835216a-04a1-4660-a458-13cca79489c3</uuid>
Nov 28 00:52:01 user nova-compute[75266]:   <name>instance-00000018</name>
Nov 28 00:52:01 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:52:01 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:52:01 user nova-compute[75266]:   <metadata>
Nov 28 00:52:01 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:52:01 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1287657777</nova:name>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:52:01</nova:creationTime>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:52:01 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:52:01 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:owner>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:user uuid="aad5a4c6583f42b39eda624923ded77b">tempest-ServerRescueNegativeTestJSON-1136436756-project-member</nova:user>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:project uuid="4e8c7ba7df64471b83fbfb45237c8ee7">tempest-ServerRescueNegativeTestJSON-1136436756</nova:project>
Nov 28 00:52:01 user nova-compute[75266]:       </nova:owner>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:52:01 user nova-compute[75266]:       <nova:ports>
Nov 28 00:52:01 user nova-compute[75266]:         <nova:port uuid="2df0bea2-3afd-4093-909a-2d0026656990">
Nov 28 00:52:01 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 00:52:01 user nova-compute[75266]:         </nova:port>
Nov 28 00:52:01 user nova-compute[75266]:       </nova:ports>
Nov 28 00:52:01 user nova-compute[75266]:     </nova:instance>
Nov 28 00:52:01 user nova-compute[75266]:   </metadata>
Nov 28 00:52:01 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:52:01 user nova-compute[75266]:     <system>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="serial">a835216a-04a1-4660-a458-13cca79489c3</entry>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="uuid">a835216a-04a1-4660-a458-13cca79489c3</entry>
Nov 28 00:52:01 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:52:01 user nova-compute[75266]:     </system>
Nov 28 00:52:01 user nova-compute[75266]:   </sysinfo>
Nov 28 00:52:01 user nova-compute[75266]:   <os>
Nov 28 00:52:01 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:52:01 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:52:01 user nova-compute[75266]:   </os>
Nov 28 00:52:01 user nova-compute[75266]:   <features>
Nov 28 00:52:01 user nova-compute[75266]:     <acpi/>
Nov 28 00:52:01 user nova-compute[75266]:     <apic/>
Nov 28 00:52:01 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:52:01 user nova-compute[75266]:   </features>
Nov 28 00:52:01 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:52:01 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:52:01 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:52:01 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:52:01 user nova-compute[75266]:   </clock>
Nov 28 00:52:01 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:52:01 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:52:01 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:52:01 user nova-compute[75266]:   </cpu>
Nov 28 00:52:01 user nova-compute[75266]:   <devices>
Nov 28 00:52:01 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:52:01 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:52:01 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue"/>
Nov 28 00:52:01 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:52:01 user nova-compute[75266]:     </disk>
Nov 28 00:52:01 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:52:01 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:52:01 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk"/>
Nov 28 00:52:01 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:52:01 user nova-compute[75266]:     </disk>
Nov 28 00:52:01 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:52:01 user nova-compute[75266]:       <mac address="fa:16:3e:74:a5:a8"/>
Nov 28 00:52:01 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:01 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:52:01 user nova-compute[75266]:       <target dev="tap2df0bea2-3a"/>
Nov 28 00:52:01 user nova-compute[75266]:     </interface>
Nov 28 00:52:01 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:52:01 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/console.log" append="off"/>
Nov 28 00:52:01 user nova-compute[75266]:     </serial>
Nov 28 00:52:01 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:52:01 user nova-compute[75266]:     <video>
Nov 28 00:52:01 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:01 user nova-compute[75266]:     </video>
Nov 28 00:52:01 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:52:01 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:52:01 user nova-compute[75266]:     </rng>
Nov 28 00:52:01 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:52:01 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:52:01 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:52:01 user nova-compute[75266]:     </memballoon>
Nov 28 00:52:01 user nova-compute[75266]:   </devices>
Nov 28 00:52:01 user nova-compute[75266]: </domain>
Nov 28 00:52:01 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:52:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance destroyed successfully.
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:52:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] No VIF found with MAC fa:16:3e:74:a5:a8, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:02 user nova-compute[75266]: WARNING nova.compute.manager [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state active and task_state rescuing.
Nov 28 00:52:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:04 user nova-compute[75266]: WARNING nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state active and task_state rescuing.
Nov 28 00:52:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:04 user nova-compute[75266]: WARNING nova.compute.manager [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state active and task_state rescuing.
Nov 28 00:52:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:52:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:13 user nova-compute[75266]: INFO nova.compute.manager [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attaching volume cc5a6f66-28f3-44c1-b6b8-93e22e704757 to /dev/vdb
Nov 28 00:52:13 user nova-compute[75266]: DEBUG os_brick.utils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ddc43-dd48-4338-9f6b-3d2231d1e6e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac502044-c05f-4258-85c9-59543f737087]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[37beb4ac-10eb-461b-a45f-d4b259cd0a78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00f52e-e093-4f0c-a265-2dc09b70e471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:52:14 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f8854-4620-460b-8db1-304be763a064]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG os_brick.utils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating existing volume attachment record: 6e01684b-b6e4-4811-b83a-bd52e73b2270 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:14 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:52:14 user nova-compute[75266]: INFO nova.compute.claims [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Claim successful on node user
Nov 28 00:52:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:52:15 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.policy [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:52:15 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Creating image(s)
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "/opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "/opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "/opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.034s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk 1073741824" returned: 0 in 0.046s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Successfully created port: 2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Cannot resize image /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Ensure instance console log exists: /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Successfully updated port: 2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquired lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:52:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-changed-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Refreshing instance network info cache due to event network-changed-2e30b84a-0f54-4293-95c7-339ccf7e830b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Acquiring lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating instance_info_cache with network_info: [{"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Releasing lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Instance network_info: |[{"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Acquired lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Refreshing network info cache for port 2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Start _get_guest_xml network_info=[{"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:52:17 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:17 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-222044104',display_name='tempest-AttachVolumeTestJSON-server-222044104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-222044104',id=26,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY2yzXm9tZGORAhgNmaczx9c+rm3QJjw8ARnx9lTlGqslv2Ded4yePiXHnC6v2wifPYeRqtHuEizTVtpjDOgsHDMsy8qhgWlqGPhwyajoZpjJ1i59I04C6u7dohvS8F3w==',key_name='tempest-keypair-1111325301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-0bosuggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=f480b3d7-0357-4dca-af75-d4cd264f5a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'pci_devices' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:52:17 user nova-compute[75266]:   <uuid>f480b3d7-0357-4dca-af75-d4cd264f5a2b</uuid>
Nov 28 00:52:17 user nova-compute[75266]:   <name>instance-0000001a</name>
Nov 28 00:52:17 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:52:17 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:52:17 user nova-compute[75266]:   <metadata>
Nov 28 00:52:17 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:52:17 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeTestJSON-server-222044104</nova:name>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:52:17</nova:creationTime>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:52:17 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:52:17 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:owner>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:user uuid="7cf2b106f48442cd84784a5880737464">tempest-AttachVolumeTestJSON-1794071981-project-member</nova:user>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:project uuid="7cf38cc0048d41bfb69a50d55f9c1963">tempest-AttachVolumeTestJSON-1794071981</nova:project>
Nov 28 00:52:17 user nova-compute[75266]:       </nova:owner>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:52:17 user nova-compute[75266]:       <nova:ports>
Nov 28 00:52:17 user nova-compute[75266]:         <nova:port uuid="2e30b84a-0f54-4293-95c7-339ccf7e830b">
Nov 28 00:52:17 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 00:52:17 user nova-compute[75266]:         </nova:port>
Nov 28 00:52:17 user nova-compute[75266]:       </nova:ports>
Nov 28 00:52:17 user nova-compute[75266]:     </nova:instance>
Nov 28 00:52:17 user nova-compute[75266]:   </metadata>
Nov 28 00:52:17 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:52:17 user nova-compute[75266]:     <system>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="serial">f480b3d7-0357-4dca-af75-d4cd264f5a2b</entry>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="uuid">f480b3d7-0357-4dca-af75-d4cd264f5a2b</entry>
Nov 28 00:52:17 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:52:17 user nova-compute[75266]:     </system>
Nov 28 00:52:17 user nova-compute[75266]:   </sysinfo>
Nov 28 00:52:17 user nova-compute[75266]:   <os>
Nov 28 00:52:17 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:52:17 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:52:17 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:52:17 user nova-compute[75266]:   </os>
Nov 28 00:52:17 user nova-compute[75266]:   <features>
Nov 28 00:52:17 user nova-compute[75266]:     <acpi/>
Nov 28 00:52:17 user nova-compute[75266]:     <apic/>
Nov 28 00:52:17 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:52:17 user nova-compute[75266]:   </features>
Nov 28 00:52:17 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:52:17 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:52:17 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:52:17 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:52:17 user nova-compute[75266]:   </clock>
Nov 28 00:52:17 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:52:17 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:52:17 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:52:17 user nova-compute[75266]:   </cpu>
Nov 28 00:52:17 user nova-compute[75266]:   <devices>
Nov 28 00:52:17 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:52:17 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:52:17 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk"/>
Nov 28 00:52:17 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:52:17 user nova-compute[75266]:     </disk>
Nov 28 00:52:17 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:52:17 user nova-compute[75266]:       <mac address="fa:16:3e:3c:21:97"/>
Nov 28 00:52:17 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:17 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:52:17 user nova-compute[75266]:       <target dev="tap2e30b84a-0f"/>
Nov 28 00:52:17 user nova-compute[75266]:     </interface>
Nov 28 00:52:17 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:52:17 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/console.log" append="off"/>
Nov 28 00:52:17 user nova-compute[75266]:     </serial>
Nov 28 00:52:17 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:52:17 user nova-compute[75266]:     <video>
Nov 28 00:52:17 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:17 user nova-compute[75266]:     </video>
Nov 28 00:52:17 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:52:17 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:52:17 user nova-compute[75266]:     </rng>
Nov 28 00:52:17 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:52:17 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:52:17 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:52:17 user nova-compute[75266]:     </memballoon>
Nov 28 00:52:17 user nova-compute[75266]:   </devices>
Nov 28 00:52:17 user nova-compute[75266]: </domain>
Nov 28 00:52:17 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-222044104',display_name='tempest-AttachVolumeTestJSON-server-222044104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-222044104',id=26,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY2yzXm9tZGORAhgNmaczx9c+rm3QJjw8ARnx9lTlGqslv2Ded4yePiXHnC6v2wifPYeRqtHuEizTVtpjDOgsHDMsy8qhgWlqGPhwyajoZpjJ1i59I04C6u7dohvS8F3w==',key_name='tempest-keypair-1111325301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-0bosuggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=f480b3d7-0357-4dca-af75-d4cd264f5a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG os_vif [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '691004a2-ed5c-5d6f-ba6a-b4112b9d4785', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e30b84a-0f, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e30b84a-0f, col_values=(('qos', UUID('364cfe8f-a037-4651-b164-6744d9418cd4')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e30b84a-0f, col_values=(('external_ids', {'iface-id': '2e30b84a-0f54-4293-95c7-339ccf7e830b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:21:97', 'vm-uuid': 'f480b3d7-0357-4dca-af75-d4cd264f5a2b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:17 user nova-compute[75266]: INFO os_vif [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f')
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No VIF found with MAC fa:16:3e:3c:21:97, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updated VIF entry in instance network info cache for port 2e30b84a-0f54-4293-95c7-339ccf7e830b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating instance_info_cache with network_info: [{"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Releasing lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:17 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] No waiting events found dispatching network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:19 user nova-compute[75266]: WARNING nova.compute.manager [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received unexpected event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b for instance with vm_state building and task_state spawning.
Nov 28 00:52:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:52:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:52:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Instance spawned successfully.
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:52:20 user nova-compute[75266]: INFO nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 28 00:52:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: INFO nova.compute.manager [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Took 6.30 seconds to build instance.
Nov 28 00:52:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] No waiting events found dispatching network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:21 user nova-compute[75266]: WARNING nova.compute.manager [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received unexpected event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b for instance with vm_state active and task_state None.
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.403s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvTCMmGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:21 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cfca04-0b7e-421b-a0ec-c07619c21881]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:52:21 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f36e5-c188-404c-b7ee-0c57c86412a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757] added
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0fd2db-c837-4002-ad25-177ea0f23336]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d80ae-307d-4445-a7cc-f583b8709220]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvTCMmGH {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvTCMmGH" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56293660-c0ed-4935-87e8-6087182ddd24]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvTCMmGH'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a6126-30da-4dd0-ae68-55ced008aa25]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6077bf-4f34-4d17-858b-b662845c7fc5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bacfc4-317c-467b-9d66-0196d06b7251]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260]
Nov 28 00:52:21 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260] successful.
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527f214-d43e-4975-a04b-5d53e09acfbb]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e90e2d2-ce05-4a8e-8d5a-6e75c80a7351]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[024727e8-2ae6-4963-907b-e7efa9fe7f0e]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvTCMmGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23365346131376632', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365346131376632', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:52:22 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:52:22 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:52:22 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:52:22 user nova-compute[75266]:   <serial>cc5a6f66-28f3-44c1-b6b8-93e22e704757</serial>
Nov 28 00:52:22 user nova-compute[75266]: </disk>
Nov 28 00:52:22 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:52:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] No VIF found with MAC fa:16:3e:d1:c0:61, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.544s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:52:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:52:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:24 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7460MB free_disk=25.196697235107422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Applying migration context for instance 41828b32-f570-4428-8064-5c199a898a04 as it has an incoming, in-progress migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3. Migration status is finished {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 00:52:24 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating resource usage from migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 00:52:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:25 user nova-compute[75266]: INFO nova.compute.manager [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Detaching volume cc5a6f66-28f3-44c1-b6b8-93e22e704757
Nov 28 00:52:25 user nova-compute[75266]: INFO nova.virt.block_device [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Attempting to driver detach volume cc5a6f66-28f3-44c1-b6b8-93e22e704757 from mountpoint /dev/vdb
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Attempting to detach device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:52:25 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:52:25 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:52:25 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:52:25 user nova-compute[75266]:   <serial>cc5a6f66-28f3-44c1-b6b8-93e22e704757</serial>
Nov 28 00:52:25 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:52:25 user nova-compute[75266]: </disk>
Nov 28 00:52:25 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:52:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the persistent domain config.
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:52:25 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:52:25 user nova-compute[75266]:   <source dev="/dev/sdf"/>
Nov 28 00:52:25 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:52:25 user nova-compute[75266]:   <serial>cc5a6f66-28f3-44c1-b6b8-93e22e704757</serial>
Nov 28 00:52:25 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:52:25 user nova-compute[75266]: </disk>
Nov 28 00:52:25 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:52:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [{"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-3f32bed1-593f-4bf4-ba26-9496d83fc17f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:52:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:52:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 00:52:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:32 user nova-compute[75266]: INFO nova.compute.manager [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Terminating instance
Nov 28 00:52:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-unplugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:52:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Instance destroyed successfully.
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lazy-loading 'resources' on Instance uuid 72e2c36d-6ae4-4af8-8511-5d36532b76e0 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-935386610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1948315245',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ==',key_name='tempest-keypair-203777967',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ea5483b85d845699f0431b1cf8f6c7f',ramdisk_id='',reservation_id='r-d9y677xm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1839048538',owner_user_name='tempest-ServerActionsV293TestJSON-1839048538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9549789f88df42959b0e1ecce3619f8b',uuid=72e2c36d-6ae4-4af8-8511-5d36532b76e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converting VIF {"id": "2d3f6903-a024-4928-afba-ce8273784c3e", "address": "fa:16:3e:bd:91:a4", "network": {"id": "50f8fe84-8683-41ef-a5e9-fff99ae620cc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-731685136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ea5483b85d845699f0431b1cf8f6c7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3f6903-a0", "ovs_interfaceid": "2d3f6903-a024-4928-afba-ce8273784c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_vif [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3f6903-a0, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=731c0758-b138-492b-b2b1-c4dd20ac0071) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:33 user nova-compute[75266]: INFO os_vif [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:91:a4,bridge_name='br-int',has_traffic_filtering=True,id=2d3f6903-a024-4928-afba-ce8273784c3e,network=Network(50f8fe84-8683-41ef-a5e9-fff99ae620cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3f6903-a0')
Nov 28 00:52:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySbBoxIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:33 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c579111-9d1f-4cb4-80b0-e5f0bb3b5c82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:52:33 user nova-compute[75266]: No targets found.
Nov 28 00:52:33 user nova-compute[75266]: iSNS:
Nov 28 00:52:33 user nova-compute[75266]: No targets found.
Nov 28 00:52:33 user nova-compute[75266]: STATIC:
Nov 28 00:52:33 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:52:33 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:33 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:33 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:52:33 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:33 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:33 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757
Nov 28 00:52:33 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:33 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:33 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:52:33 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:33 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:33 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787
Nov 28 00:52:33 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:33 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:33 user nova-compute[75266]: FIRMWARE:
Nov 28 00:52:33 user nova-compute[75266]: No targets found.
Nov 28 00:52:33 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:52:33 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:52:33 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e5d6b0-a726-456f-94a0-c1e4bbe7b897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31777d1e-051a-4b09-bc61-3097ffb08881]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:33 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bac1671c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a498e5a-9563-480a-8150-9240006f3473]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f277f-a520-4215-af1b-26887461dc68]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d3e1de-fffb-480b-8b90-c88f829e0284]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:52:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.088s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ad2490-0691-44cb-932a-ea1384302fed]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d2ed2-0ce9-4789-b7e6-5f43853feca1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62954f29-45a4-40e7-8fec-616e3603ac35]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260]
Nov 28 00:52:34 user nova-compute[75266]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787, portal: 172.16.0.220,3260] successful.
Nov 28 00:52:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b4dff1-92b2-4410-a861-a1efbadb6787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc171358-4540-471c-8c97-7e786952b845]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] <== disconnect_volume: return (356ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:52:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deleting instance files /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0_del
Nov 28 00:52:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deletion of /opt/stack/data/nova/instances/72e2c36d-6ae4-4af8-8511-5d36532b76e0_del complete
Nov 28 00:52:34 user nova-compute[75266]: INFO nova.compute.manager [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 00:52:34 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:52:34 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:35 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Took 1.07 seconds to deallocate network for instance.
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-deleted-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:35 user nova-compute[75266]: INFO nova.compute.manager [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Neutron deleted interface 2d3f6903-a024-4928-afba-ce8273784c3e; detaching it from the instance and deleting it from the info cache
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Detach interface failed, port_id=2d3f6903-a024-4928-afba-ce8273784c3e, reason: Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Acquiring lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] No waiting events found dispatching network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:35 user nova-compute[75266]: WARNING nova.compute.manager [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Received unexpected event network-vif-plugged-2d3f6903-a024-4928-afba-ce8273784c3e for instance with vm_state active and task_state deleting.
Nov 28 00:52:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:36 user nova-compute[75266]: INFO nova.compute.manager [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 00:52:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Deleting volume: c2b4dff1-92b2-4410-a861-a1efbadb6787 {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 00:52:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:52:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:52:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:36 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Deleted allocations for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0
Nov 28 00:52:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "72e2c36d-6ae4-4af8-8511-5d36532b76e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Port 9c1755ff-555e-44fa-8082-fceddb0ee343 binding to destination host user is already ACTIVE {{(pid=75266) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Creating tmpfile /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/tmp0xphb8k9 to verify with other compute node that the instance is on the same shared storage. {{(pid=75266) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:38 user nova-compute[75266]: WARNING nova.compute.manager [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state resized and task_state resize_reverting.
Nov 28 00:52:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance destroyed successfully.
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'resources' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1755ff-55, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f352509-981d-4699-aa39-2bafc5930273) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:39 user nova-compute[75266]: INFO os_vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855d1a6-b101-4b9f-a1e8-89c91344b894]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:52:39 user nova-compute[75266]: No targets found.
Nov 28 00:52:39 user nova-compute[75266]: iSNS:
Nov 28 00:52:39 user nova-compute[75266]: No targets found.
Nov 28 00:52:39 user nova-compute[75266]: STATIC:
Nov 28 00:52:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:52:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:52:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757
Nov 28 00:52:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:52:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:39 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd
Nov 28 00:52:39 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:39 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:39 user nova-compute[75266]: FIRMWARE:
Nov 28 00:52:39 user nova-compute[75266]: No targets found.
Nov 28 00:52:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:52:39 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:52:39 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb2acad-c0b8-4b00-b5f0-e1b28f52e541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1dc8fb-5a9c-484b-a9bd-61bb55577f04]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:39 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bb67df2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0457bc8-e451-416b-8275-5e9bf34dce9c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c6d8a-8138-43ad-ba0e-488af9175849]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1b8af-11c9-4a4e-b9d4-9befd728b8e0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f310c756-6628-4b98-9ec1-9402abd66a6a]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a26b8f-6ed4-4e9c-a85b-7325fb61533c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f1fbfe-b3b4-41ad-894f-af8a6b03c25f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:52:39 user nova-compute[75266]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:52:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc10051-2c75-43e4-b219-585711756b59]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== disconnect_volume: return (323ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'migration_context' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG nova.objects.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Object Instance<41828b32-f570-4428-8064-5c199a898a04> lazy-loaded attributes: resources,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:40 user nova-compute[75266]: WARNING nova.compute.manager [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state resized and task_state resize_reverting.
Nov 28 00:52:41 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.467s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:41 user nova-compute[75266]: INFO nova.compute.manager [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Swapping old allocation on dict_keys(['6332c2c0-e5e9-4188-a49b-d53a0e699e47']) held by migration 3c274f70-9be3-4b21-a2bd-649574b9b2c3 for instance
Nov 28 00:52:41 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Overwriting current allocation {'allocations': {'6332c2c0-e5e9-4188-a49b-d53a0e699e47': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'consumer_generation': 1} on consumer 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:52:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.utils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4260f-79f6-485a-a584-99573089d684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f83f1-e53d-4926-b10a-05b20d993c39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609d166-60eb-46b8-b961-8ca6c2f93c02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b0c429-924c-434b-a94e-9f4543685cd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:52:42 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:52:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0dd2bb-e038-499a-9ec9-8d933de451ef]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:52:42 user nova-compute[75266]: DEBUG os_brick.utils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:45 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 is timed out.
Nov 28 00:52:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully detached device vdb from instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 from the live domain config.
Nov 28 00:52:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvTCMmGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:45 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23d062-ee5d-4699-93fc-cafb129a1f4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:52:45 user nova-compute[75266]: No targets found.
Nov 28 00:52:45 user nova-compute[75266]: iSNS:
Nov 28 00:52:45 user nova-compute[75266]: No targets found.
Nov 28 00:52:45 user nova-compute[75266]: STATIC:
Nov 28 00:52:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:52:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757
Nov 28 00:52:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:52:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd
Nov 28 00:52:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:52:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:52:45 user nova-compute[75266]: FIRMWARE:
Nov 28 00:52:45 user nova-compute[75266]: No targets found.
Nov 28 00:52:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:52:45 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:52:45 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad965f4-a95e-45ef-8396-329b7243bb6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f10ee-42f1-4a50-a291-a1e33486fbe1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 (non-flash)
Nov 28 00:52:45 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bad9ecf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf869b-efbd-4945-90e3-409e284bf08c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2cea0-4249-4523-9f4c-16bd6cb7fd28]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e11ec8-e6d1-4ed3-a41b-8c04ed0110c3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d78611-0586-4452-a2ad-2e21960d98bd]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8889c-b8c9-4a0a-8af8-d51045876c20]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7b49f-8992-4ddb-9445-dbf8f8c9b7e5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260]
Nov 28 00:52:46 user nova-compute[75266]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757, portal: 172.16.0.220,3260] successful.
Nov 28 00:52:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc5a6f66-28f3-44c1-b6b8-93e22e704757 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41730f2-30a8-4105-875a-906d9eb425e4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] <== disconnect_volume: return (319ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:52:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'flavor' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:52:50 user nova-compute[75266]: INFO nova.compute.manager [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] instance snapshotting
Nov 28 00:52:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Beginning live snapshot process
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Starting finish_revert_migration {{(pid=75266) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start _get_guest_xml network_info=[{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '41828b32-f570-4428-8064-5c199a898a04', 'attached_at': '2023-11-28T00:52:50.000000', 'detached_at': '', 'volume_id': '307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'serial': '307a1ca3-5fc8-4700-849a-6b2cbcacd748'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '02ce705c-45f2-46a5-bca1-329ada0ec2b4', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:50 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:52:50 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:50 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:52:50 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd659a8-cc0e-422e-89d1-4e9119e8481b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:52:50 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7adfca5-3705-4ee2-b2cf-2aee6eedb32f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748] added
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5ca2c-6852-456a-b7fc-7f4c7faafa84]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94d9f7-2a15-45d7-aab3-631a6f674e31]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGKstYvH" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b75b8-14b7-404f-bea0-ec0727de9430]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGKstYvH'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1ddda-ed52-453d-81c2-720a68497a36]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da96248-d1c4-441c-8a86-d6f9c002f3d7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a66d55-94fc-440c-a8b0-538d9a5419f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:52:50 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fc79d-c095-4aaf-9e97-d1f6439bb48a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd55e005-b879-4c96-9294-0b26d654070d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae2bbd0-6f47-4c47-a144-bfd31806cbcd (non-flash)
Nov 28 00:52:50 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:52:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5cb5c-7de4-463b-8b05-8e0a3de361f7]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.216s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c.delta 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c.delta 1073741824" returned: 0 in 0.054s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 00:52:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:51 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:52:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:52:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:52:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:52:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466623239316634', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:52:52 user nova-compute[75266]:   <uuid>41828b32-f570-4428-8064-5c199a898a04</uuid>
Nov 28 00:52:52 user nova-compute[75266]:   <name>instance-00000012</name>
Nov 28 00:52:52 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:52:52 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:52:52 user nova-compute[75266]:   <metadata>
Nov 28 00:52:52 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:52:52 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherB-server-1577106707</nova:name>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:52:50</nova:creationTime>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:52:52 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:52:52 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:owner>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:user uuid="e626332697e34a0ba733c723a5ecb328">tempest-ServerActionsTestOtherB-1824523225-project-member</nova:user>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:project uuid="b57f21cfce3044c5aad7192a64ce2d8a">tempest-ServerActionsTestOtherB-1824523225</nova:project>
Nov 28 00:52:52 user nova-compute[75266]:       </nova:owner>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:52:52 user nova-compute[75266]:       <nova:ports>
Nov 28 00:52:52 user nova-compute[75266]:         <nova:port uuid="9c1755ff-555e-44fa-8082-fceddb0ee343">
Nov 28 00:52:52 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:52:52 user nova-compute[75266]:         </nova:port>
Nov 28 00:52:52 user nova-compute[75266]:       </nova:ports>
Nov 28 00:52:52 user nova-compute[75266]:     </nova:instance>
Nov 28 00:52:52 user nova-compute[75266]:   </metadata>
Nov 28 00:52:52 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:52:52 user nova-compute[75266]:     <system>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="serial">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="uuid">41828b32-f570-4428-8064-5c199a898a04</entry>
Nov 28 00:52:52 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:52:52 user nova-compute[75266]:     </system>
Nov 28 00:52:52 user nova-compute[75266]:   </sysinfo>
Nov 28 00:52:52 user nova-compute[75266]:   <os>
Nov 28 00:52:52 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:52:52 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:52:52 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:52:52 user nova-compute[75266]:   </os>
Nov 28 00:52:52 user nova-compute[75266]:   <features>
Nov 28 00:52:52 user nova-compute[75266]:     <acpi/>
Nov 28 00:52:52 user nova-compute[75266]:     <apic/>
Nov 28 00:52:52 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:52:52 user nova-compute[75266]:   </features>
Nov 28 00:52:52 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:52:52 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:52:52 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:52:52 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:52:52 user nova-compute[75266]:   </clock>
Nov 28 00:52:52 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:52:52 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:52:52 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:52:52 user nova-compute[75266]:   </cpu>
Nov 28 00:52:52 user nova-compute[75266]:   <devices>
Nov 28 00:52:52 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:52:52 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:52:52 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk"/>
Nov 28 00:52:52 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:52:52 user nova-compute[75266]:     </disk>
Nov 28 00:52:52 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:52:52 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:52:52 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:52:52 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:52:52 user nova-compute[75266]:       <serial>307a1ca3-5fc8-4700-849a-6b2cbcacd748</serial>
Nov 28 00:52:52 user nova-compute[75266]:     </disk>
Nov 28 00:52:52 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:52:52 user nova-compute[75266]:       <mac address="fa:16:3e:e3:c0:e9"/>
Nov 28 00:52:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:52 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:52:52 user nova-compute[75266]:       <target dev="tap9c1755ff-55"/>
Nov 28 00:52:52 user nova-compute[75266]:     </interface>
Nov 28 00:52:52 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:52:52 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/console.log" append="off"/>
Nov 28 00:52:52 user nova-compute[75266]:     </serial>
Nov 28 00:52:52 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:52:52 user nova-compute[75266]:     <video>
Nov 28 00:52:52 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:52:52 user nova-compute[75266]:     </video>
Nov 28 00:52:52 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:52:52 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:52:52 user nova-compute[75266]:     </rng>
Nov 28 00:52:52 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:52:52 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:52:52 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:52:52 user nova-compute[75266]:     </memballoon>
Nov 28 00:52:52 user nova-compute[75266]:   </devices>
Nov 28 00:52:52 user nova-compute[75266]: </domain>
Nov 28 00:52:52 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG os_vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96741050-df23-5933-82ff-a74e70923eb3', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1755ff-55, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1755ff-55, col_values=(('qos', UUID('8dede40c-7a6e-4f4e-b94f-ba1f7b25d952')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1755ff-55, col_values=(('external_ids', {'iface-id': '9c1755ff-555e-44fa-8082-fceddb0ee343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:c0:e9', 'vm-uuid': '41828b32-f570-4428-8064-5c199a898a04'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 4063232 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:52:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:52 user nova-compute[75266]: INFO os_vif [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:52:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 10485760 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 18153472 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 27000832 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:52:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 00:52:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:55 user nova-compute[75266]: WARNING nova.compute.manager [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state resized and task_state resize_reverting.
Nov 28 00:52:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c.delta /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:52:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c.delta /opt/stack/data/nova/instances/snapshots/tmpap42w5x8/decd2a5dea79436581b5e66710118b0c" returned: 0 in 1.406s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:52:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Snapshot extracted, beginning image upload
Nov 28 00:52:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:52:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:52:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:52:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:52:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:52:57 user nova-compute[75266]: WARNING nova.compute.manager [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state resized and task_state resize_reverting.
Nov 28 00:52:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:52:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:52:58 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance running successfully.
Nov 28 00:52:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] finish_revert_migration finished successfully. {{(pid=75266) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 00:52:58 user nova-compute[75266]: INFO nova.compute.manager [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance to original state: 'active'
Nov 28 00:52:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Snapshot image upload complete
Nov 28 00:52:59 user nova-compute[75266]: INFO nova.compute.manager [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Took 9.99 seconds to snapshot the instance on the hypervisor.
Nov 28 00:53:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:53:02 user nova-compute[75266]: INFO nova.compute.claims [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Claim successful on node user
Nov 28 00:53:02 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:02 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:53:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:53:03 user nova-compute[75266]: INFO nova.virt.block_device [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Booting with volume cbf2ecb0-05e5-411a-9dfb-33928d958c2c at /dev/vda
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.policy [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.utils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbbf4d0-896d-4e74-a194-449d55ca493f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd5c197-1d9a-454e-80ce-467d58730eb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2150d8-d463-4a93-8654-34296ab12a24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf2ac4-b4a7-4f9a-8cdc-8fbaab873410]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:53:03 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55fe2fc-65ce-4e9f-90aa-eefc3afbf209]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG os_brick.utils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating existing volume attachment record: e7506863-a2ef-4565-8a1d-3b6213f6fac5 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:53:04 user nova-compute[75266]: INFO nova.compute.claims [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Claim successful on node user
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Successfully created port: 2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:53:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.policy [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:53:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Creating image(s)
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Successfully updated port: 2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-changed-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Refreshing instance network info cache due to event network-changed-2f437b2e-0b70-4d62-8011-839cbc9a06bb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.304s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk 1073741824" returned: 0 in 0.057s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance network_info: |[{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Refreshing network info cache for port 2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Cannot resize image /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Ensure instance console log exists: /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updated VIF entry in instance network info cache for port 2f437b2e-0b70-4d62-8011-839cbc9a06bb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Successfully created port: ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Successfully updated port: ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing instance network info cache due to event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance network_info: |[{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.neutron [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start _get_guest_xml network_info=[{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:53:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpUFquDeumIIdDQAaGyNyeGGAa5cfVSI7FFpRzGGGZzYV4GV1jUbn8wjNU0WSYASKLUcvewvIMnW8sX+yZuTGWUBWmFHdYqYTml4tXyMStLNULR7tj9BXfQY6FltgCdBQ==',key_name='tempest-keypair-1702320399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:53:07 user nova-compute[75266]:   <uuid>5fcab10a-4f5f-479c-9d0c-907bcea7d87e</uuid>
Nov 28 00:53:07 user nova-compute[75266]:   <name>instance-0000001c</name>
Nov 28 00:53:07 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:53:07 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:53:07 user nova-compute[75266]:   <metadata>
Nov 28 00:53:07 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:53:07 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2078984112</nova:name>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:53:07</nova:creationTime>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:53:07 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:53:07 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:owner>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:user uuid="1fd50f4f867e4efcad9e16d45dde6df0">tempest-AttachVolumeShelveTestJSON-107867446-project-member</nova:user>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:project uuid="52c236f1599d4a4fb181b4aa73058211">tempest-AttachVolumeShelveTestJSON-107867446</nova:project>
Nov 28 00:53:07 user nova-compute[75266]:       </nova:owner>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:53:07 user nova-compute[75266]:       <nova:ports>
Nov 28 00:53:07 user nova-compute[75266]:         <nova:port uuid="ea295632-a11a-4926-b87a-c3fda4b47a47">
Nov 28 00:53:07 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:53:07 user nova-compute[75266]:         </nova:port>
Nov 28 00:53:07 user nova-compute[75266]:       </nova:ports>
Nov 28 00:53:07 user nova-compute[75266]:     </nova:instance>
Nov 28 00:53:07 user nova-compute[75266]:   </metadata>
Nov 28 00:53:07 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:53:07 user nova-compute[75266]:     <system>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="serial">5fcab10a-4f5f-479c-9d0c-907bcea7d87e</entry>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="uuid">5fcab10a-4f5f-479c-9d0c-907bcea7d87e</entry>
Nov 28 00:53:07 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:53:07 user nova-compute[75266]:     </system>
Nov 28 00:53:07 user nova-compute[75266]:   </sysinfo>
Nov 28 00:53:07 user nova-compute[75266]:   <os>
Nov 28 00:53:07 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:53:07 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:53:07 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:53:07 user nova-compute[75266]:   </os>
Nov 28 00:53:07 user nova-compute[75266]:   <features>
Nov 28 00:53:07 user nova-compute[75266]:     <acpi/>
Nov 28 00:53:07 user nova-compute[75266]:     <apic/>
Nov 28 00:53:07 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:53:07 user nova-compute[75266]:   </features>
Nov 28 00:53:07 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:53:07 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:53:07 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:53:07 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:53:07 user nova-compute[75266]:   </clock>
Nov 28 00:53:07 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:53:07 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:53:07 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:53:07 user nova-compute[75266]:   </cpu>
Nov 28 00:53:07 user nova-compute[75266]:   <devices>
Nov 28 00:53:07 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:53:07 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:53:07 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk"/>
Nov 28 00:53:07 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:53:07 user nova-compute[75266]:     </disk>
Nov 28 00:53:07 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:53:07 user nova-compute[75266]:       <mac address="fa:16:3e:30:11:20"/>
Nov 28 00:53:07 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:07 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:53:07 user nova-compute[75266]:       <target dev="tapea295632-a1"/>
Nov 28 00:53:07 user nova-compute[75266]:     </interface>
Nov 28 00:53:07 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:53:07 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/console.log" append="off"/>
Nov 28 00:53:07 user nova-compute[75266]:     </serial>
Nov 28 00:53:07 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:53:07 user nova-compute[75266]:     <video>
Nov 28 00:53:07 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:07 user nova-compute[75266]:     </video>
Nov 28 00:53:07 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:53:07 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:53:07 user nova-compute[75266]:     </rng>
Nov 28 00:53:07 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:53:07 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:53:07 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:53:07 user nova-compute[75266]:     </memballoon>
Nov 28 00:53:07 user nova-compute[75266]:   </devices>
Nov 28 00:53:07 user nova-compute[75266]: </domain>
Nov 28 00:53:07 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpUFquDeumIIdDQAaGyNyeGGAa5cfVSI7FFpRzGGGZzYV4GV1jUbn8wjNU0WSYASKLUcvewvIMnW8sX+yZuTGWUBWmFHdYqYTml4tXyMStLNULR7tj9BXfQY6FltgCdBQ==',key_name='tempest-keypair-1702320399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG os_vif [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2224f41-2ecc-5a2e-bcfd-fcf20e93098e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea295632-a1, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea295632-a1, col_values=(('qos', UUID('aaff6596-101c-43d7-a70c-f53c02c41810')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea295632-a1, col_values=(('external_ids', {'iface-id': 'ea295632-a11a-4926-b87a-c3fda4b47a47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:11:20', 'vm-uuid': '5fcab10a-4f5f-479c-9d0c-907bcea7d87e'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:07 user nova-compute[75266]: INFO os_vif [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1')
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:53:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No VIF found with MAC fa:16:3e:30:11:20, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:53:08 user nova-compute[75266]: DEBUG nova.network.neutron [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updated VIF entry in instance network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:53:08 user nova-compute[75266]: DEBUG nova.network.neutron [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:09 user nova-compute[75266]: WARNING nova.compute.manager [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state building and task_state spawning.
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:53:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Creating image(s)
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Ensure instance console log exists: /opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start _get_guest_xml network_info=[{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08844c7b-f7ca-4c50-ac58-eccff6064ec4', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'serial': 'cbf2ecb0-05e5-411a-9dfb-33928d958c2c'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e7506863-a2ef-4565-8a1d-3b6213f6fac5', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:53:11 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:11 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:53:11 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:53:11 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:53:11 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[745bfce7-192a-41d8-b402-b0cd3142090f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:53:11 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:53:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance spawned successfully.
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6cd7f5-26da-4a60-af4c-e1bf578c7af2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c] added
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2700b6-fd39-45a1-8ff9-e0f36b3f1e35]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc774002-6d8c-40ea-971e-bcdb81da1edc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShpULPrK {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShpULPrK" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3309aa8-e36e-4321-b161-4854adc109a8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShpULPrK'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a63001-a3af-460c-86d6-b0953d63459b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb1e931-1cb6-4c71-a2b3-f15c48301711]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:53:11 user nova-compute[75266]: INFO nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:11 user nova-compute[75266]: WARNING nova.compute.manager [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state building and task_state spawning.
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c766bbc-009a-4049-b0ec-bf8e9c3e7c80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]
Nov 28 00:53:11 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38340226-97bb-4be9-bb43-a326bf12000e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f7704-848e-460f-bb39-6b711a44ab14]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:53:11 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:53:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:11 user nova-compute[75266]: INFO nova.compute.manager [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Took 7.80 seconds to build instance.
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8994cf4-d253-4448-86c9-7d2bf1fd77da]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:53:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.967s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23630303533333538', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630303533333538', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'pci_devices' on Instance uuid 08844c7b-f7ca-4c50-ac58-eccff6064ec4 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:53:12 user nova-compute[75266]:   <uuid>08844c7b-f7ca-4c50-ac58-eccff6064ec4</uuid>
Nov 28 00:53:12 user nova-compute[75266]:   <name>instance-0000001b</name>
Nov 28 00:53:12 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:53:12 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:53:12 user nova-compute[75266]:   <metadata>
Nov 28 00:53:12 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:53:12 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:53:12 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherA-server-965644235</nova:name>
Nov 28 00:53:12 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:53:11</nova:creationTime>
Nov 28 00:53:12 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:53:12 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:53:12 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:53:12 user nova-compute[75266]:       <nova:owner>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:user uuid="f63a0e9261934c8b8e673f069c3376bd">tempest-ServerActionsTestOtherA-277302336-project-member</nova:user>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:project uuid="22c31829ff0846fc8584d492bea6cdc4">tempest-ServerActionsTestOtherA-277302336</nova:project>
Nov 28 00:53:12 user nova-compute[75266]:       </nova:owner>
Nov 28 00:53:12 user nova-compute[75266]:       <nova:ports>
Nov 28 00:53:12 user nova-compute[75266]:         <nova:port uuid="2f437b2e-0b70-4d62-8011-839cbc9a06bb">
Nov 28 00:53:12 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:53:12 user nova-compute[75266]:         </nova:port>
Nov 28 00:53:12 user nova-compute[75266]:       </nova:ports>
Nov 28 00:53:12 user nova-compute[75266]:     </nova:instance>
Nov 28 00:53:12 user nova-compute[75266]:   </metadata>
Nov 28 00:53:12 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:53:12 user nova-compute[75266]:     <system>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="serial">08844c7b-f7ca-4c50-ac58-eccff6064ec4</entry>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="uuid">08844c7b-f7ca-4c50-ac58-eccff6064ec4</entry>
Nov 28 00:53:12 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:53:12 user nova-compute[75266]:     </system>
Nov 28 00:53:12 user nova-compute[75266]:   </sysinfo>
Nov 28 00:53:12 user nova-compute[75266]:   <os>
Nov 28 00:53:12 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:53:12 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:53:12 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:53:12 user nova-compute[75266]:   </os>
Nov 28 00:53:12 user nova-compute[75266]:   <features>
Nov 28 00:53:12 user nova-compute[75266]:     <acpi/>
Nov 28 00:53:12 user nova-compute[75266]:     <apic/>
Nov 28 00:53:12 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:53:12 user nova-compute[75266]:   </features>
Nov 28 00:53:12 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:53:12 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:53:12 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:53:12 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:53:12 user nova-compute[75266]:   </clock>
Nov 28 00:53:12 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:53:12 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:53:12 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:53:12 user nova-compute[75266]:   </cpu>
Nov 28 00:53:12 user nova-compute[75266]:   <devices>
Nov 28 00:53:12 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:53:12 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:53:12 user nova-compute[75266]:       <source dev="/dev/sde"/>
Nov 28 00:53:12 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:53:12 user nova-compute[75266]:       <serial>cbf2ecb0-05e5-411a-9dfb-33928d958c2c</serial>
Nov 28 00:53:12 user nova-compute[75266]:     </disk>
Nov 28 00:53:12 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:53:12 user nova-compute[75266]:       <mac address="fa:16:3e:6d:ab:83"/>
Nov 28 00:53:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:12 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:53:12 user nova-compute[75266]:       <target dev="tap2f437b2e-0b"/>
Nov 28 00:53:12 user nova-compute[75266]:     </interface>
Nov 28 00:53:12 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:53:12 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4/console.log" append="off"/>
Nov 28 00:53:12 user nova-compute[75266]:     </serial>
Nov 28 00:53:12 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:53:12 user nova-compute[75266]:     <video>
Nov 28 00:53:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:12 user nova-compute[75266]:     </video>
Nov 28 00:53:12 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:53:12 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:53:12 user nova-compute[75266]:     </rng>
Nov 28 00:53:12 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:53:12 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:53:12 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:53:12 user nova-compute[75266]:     </memballoon>
Nov 28 00:53:12 user nova-compute[75266]:   </devices>
Nov 28 00:53:12 user nova-compute[75266]: </domain>
Nov 28 00:53:12 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG os_vif [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a321591e-a468-5e77-9098-5fda1d1966d6', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f437b2e-0b, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f437b2e-0b, col_values=(('qos', UUID('bd6849bb-8c57-4f77-8502-6b33426534a2')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f437b2e-0b, col_values=(('external_ids', {'iface-id': '2f437b2e-0b70-4d62-8011-839cbc9a06bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:ab:83', 'vm-uuid': '08844c7b-f7ca-4c50-ac58-eccff6064ec4'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:12 user nova-compute[75266]: INFO os_vif [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b')
Nov 28 00:53:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:53:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:6d:ab:83, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:14 user nova-compute[75266]: WARNING nova.compute.manager [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state building and task_state spawning.
Nov 28 00:53:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:53:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance spawned successfully.
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:16 user nova-compute[75266]: WARNING nova.compute.manager [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state building and task_state spawning.
Nov 28 00:53:16 user nova-compute[75266]: INFO nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 28 00:53:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:53:16 user nova-compute[75266]: INFO nova.compute.manager [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Took 14.47 seconds to build instance.
Nov 28 00:53:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.597s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:53:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:25 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:25 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7441MB free_disk=25.13277816772461GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:53:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:26 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:26 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:53:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:53:30 user nova-compute[75266]: INFO nova.compute.claims [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Claim successful on node user
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:53:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.policy [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:53:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Creating image(s)
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "/opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "/opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "/opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk 1073741824" returned: 0 in 0.155s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Successfully created port: 2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Cannot resize image /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Ensure instance console log exists: /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Successfully updated port: 2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquired lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing instance network info cache due to event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Acquiring lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Releasing lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Instance network_info: |[{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Acquired lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Start _get_guest_xml network_info=[{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:53:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-191779408',display_name='tempest-TestStampPattern-server-191779408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-191779408',id=29,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-bnr3eycd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:31Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=3702ef7a-256e-4dbe-9b8c-2980c83ddb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'pci_devices' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:53:33 user nova-compute[75266]:   <uuid>3702ef7a-256e-4dbe-9b8c-2980c83ddb84</uuid>
Nov 28 00:53:33 user nova-compute[75266]:   <name>instance-0000001d</name>
Nov 28 00:53:33 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:53:33 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:53:33 user nova-compute[75266]:   <metadata>
Nov 28 00:53:33 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:53:33 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:name>tempest-TestStampPattern-server-191779408</nova:name>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:53:33</nova:creationTime>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:53:33 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:53:33 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:owner>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:user uuid="725ae105f36b4b1ca7422d6237a51ff8">tempest-TestStampPattern-1934253251-project-member</nova:user>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:project uuid="7a6914d589cc40088c765d5ae8fdd28c">tempest-TestStampPattern-1934253251</nova:project>
Nov 28 00:53:33 user nova-compute[75266]:       </nova:owner>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:53:33 user nova-compute[75266]:       <nova:ports>
Nov 28 00:53:33 user nova-compute[75266]:         <nova:port uuid="2c602f33-1cb2-4d10-b074-9348e302816a">
Nov 28 00:53:33 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 00:53:33 user nova-compute[75266]:         </nova:port>
Nov 28 00:53:33 user nova-compute[75266]:       </nova:ports>
Nov 28 00:53:33 user nova-compute[75266]:     </nova:instance>
Nov 28 00:53:33 user nova-compute[75266]:   </metadata>
Nov 28 00:53:33 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:53:33 user nova-compute[75266]:     <system>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="serial">3702ef7a-256e-4dbe-9b8c-2980c83ddb84</entry>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="uuid">3702ef7a-256e-4dbe-9b8c-2980c83ddb84</entry>
Nov 28 00:53:33 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:53:33 user nova-compute[75266]:     </system>
Nov 28 00:53:33 user nova-compute[75266]:   </sysinfo>
Nov 28 00:53:33 user nova-compute[75266]:   <os>
Nov 28 00:53:33 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:53:33 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:53:33 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:53:33 user nova-compute[75266]:   </os>
Nov 28 00:53:33 user nova-compute[75266]:   <features>
Nov 28 00:53:33 user nova-compute[75266]:     <acpi/>
Nov 28 00:53:33 user nova-compute[75266]:     <apic/>
Nov 28 00:53:33 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:53:33 user nova-compute[75266]:   </features>
Nov 28 00:53:33 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:53:33 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:53:33 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:53:33 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:53:33 user nova-compute[75266]:   </clock>
Nov 28 00:53:33 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:53:33 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:53:33 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:53:33 user nova-compute[75266]:   </cpu>
Nov 28 00:53:33 user nova-compute[75266]:   <devices>
Nov 28 00:53:33 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:53:33 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:53:33 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk"/>
Nov 28 00:53:33 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:53:33 user nova-compute[75266]:     </disk>
Nov 28 00:53:33 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:53:33 user nova-compute[75266]:       <mac address="fa:16:3e:cd:cd:ab"/>
Nov 28 00:53:33 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:33 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:53:33 user nova-compute[75266]:       <target dev="tap2c602f33-1c"/>
Nov 28 00:53:33 user nova-compute[75266]:     </interface>
Nov 28 00:53:33 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:53:33 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/console.log" append="off"/>
Nov 28 00:53:33 user nova-compute[75266]:     </serial>
Nov 28 00:53:33 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:53:33 user nova-compute[75266]:     <video>
Nov 28 00:53:33 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:53:33 user nova-compute[75266]:     </video>
Nov 28 00:53:33 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:53:33 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:53:33 user nova-compute[75266]:     </rng>
Nov 28 00:53:33 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:53:33 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:53:33 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:53:33 user nova-compute[75266]:     </memballoon>
Nov 28 00:53:33 user nova-compute[75266]:   </devices>
Nov 28 00:53:33 user nova-compute[75266]: </domain>
Nov 28 00:53:33 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-191779408',display_name='tempest-TestStampPattern-server-191779408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-191779408',id=29,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-bnr3eycd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:31Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=3702ef7a-256e-4dbe-9b8c-2980c83ddb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG os_vif [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1381b09f-9b0f-58e2-b791-a840c3c70862', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c602f33-1c, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c602f33-1c, col_values=(('qos', UUID('eafa036d-27cf-4589-9cb4-ea232fb97037')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c602f33-1c, col_values=(('external_ids', {'iface-id': '2c602f33-1cb2-4d10-b074-9348e302816a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:cd:ab', 'vm-uuid': '3702ef7a-256e-4dbe-9b8c-2980c83ddb84'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:33 user nova-compute[75266]: INFO os_vif [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c')
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No VIF found with MAC fa:16:3e:cd:cd:ab, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updated VIF entry in instance network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG nova.network.neutron [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Releasing lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] No waiting events found dispatching network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:35 user nova-compute[75266]: WARNING nova.compute.manager [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received unexpected event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a for instance with vm_state building and task_state spawning.
Nov 28 00:53:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:53:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Instance spawned successfully.
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.compute.manager [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] No waiting events found dispatching network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:37 user nova-compute[75266]: WARNING nova.compute.manager [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received unexpected event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a for instance with vm_state building and task_state spawning.
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:53:37 user nova-compute[75266]: INFO nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 28 00:53:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:53:37 user nova-compute[75266]: INFO nova.compute.manager [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Took 7.29 seconds to build instance.
Nov 28 00:53:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.538s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:42 user nova-compute[75266]: INFO nova.compute.manager [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Terminating instance
Nov 28 00:53:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-unplugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] No waiting events found dispatching network-vif-unplugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-unplugged-65e249eb-8337-4f50-b643-927be5058f5e for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Instance destroyed successfully.
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'resources' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-159767708',display_name='tempest-SnapshotDataIntegrityTests-server-159767708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-159767708',id=19,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQT93B1uIu5X8ATFza/6QgBPFdK/6Mj2vlay+fJdO/NuBhwWV8F2g3oDnIf2Cvqh9Pygmd8ZgZE5MRMhTiHjAmoHx0hy5rIBY0Xs3DmMePM0qt2SWEAhGwI0quO8mHUaA==',key_name='tempest-keypair-213731965',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ab8531e1e740798cff8ce9dd2cb311',ramdisk_id='',reservation_id='r-fsdh7hqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1920079985',owner_user_name='tempest-SnapshotDataIntegrityTests-1920079985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4a78fd7893c4c17acd06b280542b631',uuid=0fc5430b-5c2a-4074-886e-d53482cb2bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converting VIF {"id": "65e249eb-8337-4f50-b643-927be5058f5e", "address": "fa:16:3e:d1:c0:61", "network": {"id": "975a9d81-7f86-4e83-a619-7c0454d3a3e9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-23519506-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ab8531e1e740798cff8ce9dd2cb311", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65e249eb-83", "ovs_interfaceid": "65e249eb-8337-4f50-b643-927be5058f5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG os_vif [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65e249eb-83, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adddbb40-2a2b-4509-a6b9-77c1a2c2193b) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:53:43 user nova-compute[75266]: INFO os_vif [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=65e249eb-8337-4f50-b643-927be5058f5e,network=Network(975a9d81-7f86-4e83-a619-7c0454d3a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65e249eb-83')
Nov 28 00:53:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Deleting instance files /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9_del
Nov 28 00:53:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Deletion of /opt/stack/data/nova/instances/0fc5430b-5c2a-4074-886e-d53482cb2bb9_del complete
Nov 28 00:53:43 user nova-compute[75266]: INFO nova.compute.manager [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 00:53:43 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:43 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:44 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Took 0.89 seconds to deallocate network for instance.
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-deleted-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:44 user nova-compute[75266]: INFO nova.compute.manager [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Neutron deleted interface 65e249eb-8337-4f50-b643-927be5058f5e; detaching it from the instance and deleting it from the info cache
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.network.neutron [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Detach interface failed, port_id=65e249eb-8337-4f50-b643-927be5058f5e, reason: Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:44 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Deleted allocations for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Acquiring lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Lock "0fc5430b-5c2a-4074-886e-d53482cb2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] No waiting events found dispatching network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:44 user nova-compute[75266]: WARNING nova.compute.manager [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Received unexpected event network-vif-plugged-65e249eb-8337-4f50-b643-927be5058f5e for instance with vm_state deleted and task_state None.
Nov 28 00:53:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:51 user nova-compute[75266]: INFO nova.compute.manager [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Unrescuing
Nov 28 00:53:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:52 user nova-compute[75266]: WARNING nova.compute.manager [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:53:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance destroyed successfully.
Nov 28 00:53:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:54 user nova-compute[75266]: WARNING nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:54 user nova-compute[75266]: WARNING nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:53:54 user nova-compute[75266]: WARNING nova.compute.manager [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:53:54 user nova-compute[75266]: INFO nova.compute.claims [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Claim successful on node user
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:53:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:53:54 user nova-compute[75266]: INFO nova.virt.block_device [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Booting with volume snapshot a141f326-29c7-4dac-b92c-95a7f24ef513 at /dev/vda
Nov 28 00:53:54 user nova-compute[75266]: DEBUG nova.policy [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:53:55 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Successfully created port: ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:53:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Successfully updated port: ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-changed-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Refreshing instance network info cache due to event network-changed-ad4c074f-c4eb-44e5-af60-5d63c0776018. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Acquiring lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:53:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Updating instance_info_cache with network_info: [{"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Instance network_info: |[{"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Acquired lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Refreshing network info cache for port ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Updated VIF entry in instance network info cache for port ad4c074f-c4eb-44e5-af60-5d63c0776018. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Updating instance_info_cache with network_info: [{"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:53:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Releasing lock "refresh_cache-9d7f368b-5aca-4be6-8844-a207bee693b2" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:53:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1d9958-225d-4c6b-a23d-f0394e3138d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0012f2-669b-4e60-a6d1-7e47c9e71bc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dcdb24-335d-4c8d-97d0-4d74b8265d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a625027-105f-4339-b4ad-08b36eeb189c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:00 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:54:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f15e20b-e9fc-4850-9448-e1a180b578d2]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:00 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Updating existing volume attachment record: 7521cbdf-805b-46a0-8c7d-df7e64b82bb9 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:54:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:54:02 user nova-compute[75266]: INFO nova.compute.claims [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Claim successful on node user
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:54:02 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:54:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:54:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:54:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:03 user nova-compute[75266]: DEBUG nova.policy [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:54:03 user nova-compute[75266]: INFO nova.virt.block_device [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Booting with volume-backed-image 0eca691f-8ae7-4ede-a543-e4f526783da7 at /dev/vda
Nov 28 00:54:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Successfully created port: 4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Successfully updated port: 4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-changed-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Refreshing instance network info cache due to event network-changed-4b85a0a3-79a9-4e29-9559-5d25b03f7db5. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Acquiring lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating instance_info_cache with network_info: [{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance network_info: |[{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Acquired lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:04 user nova-compute[75266]: DEBUG nova.network.neutron [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Refreshing network info cache for port 4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updated VIF entry in instance network info cache for port 4b85a0a3-79a9-4e29-9559-5d25b03f7db5. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating instance_info_cache with network_info: [{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Releasing lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-changed-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Refreshing instance network info cache due to event network-changed-2e30b84a-0f54-4293-95c7-339ccf7e830b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Acquiring lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Acquired lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Refreshing network info cache for port 2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:54:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updated VIF entry in instance network info cache for port 2e30b84a-0f54-4293-95c7-339ccf7e830b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:54:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating instance_info_cache with network_info: [{"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Releasing lock "refresh_cache-f480b3d7-0357-4dca-af75-d4cd264f5a2b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:54:08 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Creating image(s)
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7f368b-5aca-4be6-8844-a207bee693b2/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Start _get_guest_xml network_info=[{"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFmanBSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d7f368b-5aca-4be6-8844-a207bee693b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0878e47-41b4-44a6-b327-3481eae2484d', 'serial': 'b0878e47-41b4-44a6-b327-3481eae2484d'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '7521cbdf-805b-46a0-8c7d-df7e64b82bb9', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:54:08 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:08 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFmanBSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:08 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:08 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:08 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861845c-1602-4dde-9a86-0946c5c085e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:54:08 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3cc6f-0942-4510-ba09-537d3efa135f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d] added
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:08 user nova-compute[75266]: INFO nova.compute.manager [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attaching volume 96cca523-fcec-4118-9da5-3cd8302ca3eb to /dev/vdb
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef2f467-90ac-41d8-8644-dad1e3e3cd3e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d128e4f9-7607-4d90-84bc-3fc5c089a23c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFmanBSL {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFmanBSL" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa74fb-6a5a-4799-beda-4d8a0210e53c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uFmanBSL'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed8641-1b9b-4d35-8059-b09f31ff9cf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056fcc1-d1c2-41c1-9686-84dd4ba767f9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ebeeb0-8587-4c78-bdac-e6b203066e46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c28f60-e789-4bbc-807b-785c4d2e7d66]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d6390-6625-40b9-b957-b73b131d8872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[554c109c-dcc0-4091-a435-16ec45bd21c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:08 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9040c0-ed73-4861-89cd-3e1d68b0908a]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating existing volume attachment record: 1605b1c6-b043-4faf-8b57-098b19ae84e6 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64e34b-5bc4-4e5a-a735-998d757302a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5183ba-8abe-4874-bc0f-67ee0985d1bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260]
Nov 28 00:54:08 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa984eaf-8fb3-4640-8ac2-5b1e022abbd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f61c0-9fe5-4608-825d-cf5580d1bd8f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6777d0b9-58a8-4080-bb53-193e76031b29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bccd910-9dcb-479e-80fc-b6fb69065658]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7568e7b3-1715-40e5-b8c1-b71373a9e0cb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:08 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:08 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:08 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f333c-99f4-4174-b685-76a23223035e]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.utils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating existing volume attachment record: e8c1e6bc-a19c-47ba-9b5c-4471dc78424e {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d00be6-a441-4601-b78a-12ceced4ec33]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:54:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFmanBSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23631376437653636', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631376437653636', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1752779599',display_name='tempest-TestVolumeBootPattern-server-1752779599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1752779599',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-gmkl99rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:55Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=9d7f368b-5aca-4be6-8844-a207bee693b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:54:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d7f368b-5aca-4be6-8844-a207bee693b2 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:54:10 user nova-compute[75266]:   <uuid>9d7f368b-5aca-4be6-8844-a207bee693b2</uuid>
Nov 28 00:54:10 user nova-compute[75266]:   <name>instance-0000001e</name>
Nov 28 00:54:10 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:54:10 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:54:10 user nova-compute[75266]:   <metadata>
Nov 28 00:54:10 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:54:10 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:54:10 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-server-1752779599</nova:name>
Nov 28 00:54:10 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:54:08</nova:creationTime>
Nov 28 00:54:10 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:54:10 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:54:10 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:54:10 user nova-compute[75266]:       <nova:owner>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 00:54:10 user nova-compute[75266]:       </nova:owner>
Nov 28 00:54:10 user nova-compute[75266]:       <nova:ports>
Nov 28 00:54:10 user nova-compute[75266]:         <nova:port uuid="ad4c074f-c4eb-44e5-af60-5d63c0776018">
Nov 28 00:54:10 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 00:54:10 user nova-compute[75266]:         </nova:port>
Nov 28 00:54:10 user nova-compute[75266]:       </nova:ports>
Nov 28 00:54:10 user nova-compute[75266]:     </nova:instance>
Nov 28 00:54:10 user nova-compute[75266]:   </metadata>
Nov 28 00:54:10 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:54:10 user nova-compute[75266]:     <system>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="serial">9d7f368b-5aca-4be6-8844-a207bee693b2</entry>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="uuid">9d7f368b-5aca-4be6-8844-a207bee693b2</entry>
Nov 28 00:54:10 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:54:10 user nova-compute[75266]:     </system>
Nov 28 00:54:10 user nova-compute[75266]:   </sysinfo>
Nov 28 00:54:10 user nova-compute[75266]:   <os>
Nov 28 00:54:10 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:54:10 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:54:10 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:54:10 user nova-compute[75266]:   </os>
Nov 28 00:54:10 user nova-compute[75266]:   <features>
Nov 28 00:54:10 user nova-compute[75266]:     <acpi/>
Nov 28 00:54:10 user nova-compute[75266]:     <apic/>
Nov 28 00:54:10 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:54:10 user nova-compute[75266]:   </features>
Nov 28 00:54:10 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:54:10 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:54:10 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:54:10 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:54:10 user nova-compute[75266]:   </clock>
Nov 28 00:54:10 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:54:10 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:54:10 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:54:10 user nova-compute[75266]:   </cpu>
Nov 28 00:54:10 user nova-compute[75266]:   <devices>
Nov 28 00:54:10 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:54:10 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:10 user nova-compute[75266]:       <source dev="/dev/sdf"/>
Nov 28 00:54:10 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:54:10 user nova-compute[75266]:       <serial>b0878e47-41b4-44a6-b327-3481eae2484d</serial>
Nov 28 00:54:10 user nova-compute[75266]:     </disk>
Nov 28 00:54:10 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:54:10 user nova-compute[75266]:       <mac address="fa:16:3e:b9:80:a4"/>
Nov 28 00:54:10 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:54:10 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:54:10 user nova-compute[75266]:       <target dev="tapad4c074f-c4"/>
Nov 28 00:54:10 user nova-compute[75266]:     </interface>
Nov 28 00:54:10 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:54:10 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/9d7f368b-5aca-4be6-8844-a207bee693b2/console.log" append="off"/>
Nov 28 00:54:10 user nova-compute[75266]:     </serial>
Nov 28 00:54:10 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:54:10 user nova-compute[75266]:     <video>
Nov 28 00:54:10 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:54:10 user nova-compute[75266]:     </video>
Nov 28 00:54:10 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:54:10 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:54:10 user nova-compute[75266]:     </rng>
Nov 28 00:54:10 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:54:10 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:54:10 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:54:10 user nova-compute[75266]:     </memballoon>
Nov 28 00:54:10 user nova-compute[75266]:   </devices>
Nov 28 00:54:10 user nova-compute[75266]: </domain>
Nov 28 00:54:10 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1752779599',display_name='tempest-TestVolumeBootPattern-server-1752779599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1752779599',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-gmkl99rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:53:55Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=9d7f368b-5aca-4be6-8844-a207bee693b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG os_vif [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b179993f-c9a1-55a6-94b4-99be0e2f4c03', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4c074f-c4, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad4c074f-c4, col_values=(('qos', UUID('ba07e0a7-8124-434f-8131-4526e5d7d585')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad4c074f-c4, col_values=(('external_ids', {'iface-id': 'ad4c074f-c4eb-44e5-af60-5d63c0776018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:80:a4', 'vm-uuid': '9d7f368b-5aca-4be6-8844-a207bee693b2'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:10 user nova-compute[75266]: INFO os_vif [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4')
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:b9:80:a4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] No waiting events found dispatching network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:11 user nova-compute[75266]: WARNING nova.compute.manager [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received unexpected event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance with vm_state building and task_state spawning.
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:54:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Instance spawned successfully.
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:13 user nova-compute[75266]: INFO nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] No waiting events found dispatching network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:13 user nova-compute[75266]: WARNING nova.compute.manager [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received unexpected event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance with vm_state building and task_state spawning.
Nov 28 00:54:13 user nova-compute[75266]: INFO nova.compute.manager [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Took 19.37 seconds to build instance.
Nov 28 00:54:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.471s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkDRJZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:16 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02670e2-6fc3-4840-88d4-117d13f94757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:54:16 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff11af-3323-4361-a03f-9853c2e85646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb] added
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efec504-5687-4490-811c-fe5ca632772a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d905ebb-096b-4cc0-ae3e-b0774f75759d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkDRJZpt {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkDRJZpt" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a21d88-19c1-48b4-9d16-e3433613328f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkDRJZpt'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6974b8-c664-4f11-ae72-3d06f5c1ff68]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:54:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Creating image(s)
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Ensure instance console log exists: /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start _get_guest_xml network_info=[{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '500f7840-d86c-4620-b93f-9065ebe4872f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'serial': 'a86af50f-7d6b-47e2-b25e-e6b6bc69d03b'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e8c1e6bc-a19c-47ba-9b5c-4471dc78424e', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:54:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91427d-faf0-4132-92b3-11a75aea4cc5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c9b98-ecc3-417f-9b4f-6da07696e7d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260]
Nov 28 00:54:16 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e4f72d-c9a7-420f-9db5-d0ae30ba3951]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2277a8-75d4-4856-aa59-8b715c0a602b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:16 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527186a-05d1-429b-96c4-6aae665f1046]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:54:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkDRJZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23033303962316639', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303962316639', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.153s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:17 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:17 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ef73a-83fb-4076-a1f9-12611e2dd45c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:54:17 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:54:17 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:17 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:54:17 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:54:17 user nova-compute[75266]:   <serial>96cca523-fcec-4118-9da5-3cd8302ca3eb</serial>
Nov 28 00:54:17 user nova-compute[75266]: </disk>
Nov 28 00:54:17 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f2055-bc2a-49ad-86a4-941d19808ca3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b] added
Nov 28 00:54:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f45f8fb-cae9-48b7-8caa-95e6d4b989ad]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a56fc-7277-44e7-a105-c081cee3ca39]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBsquJk {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBsquJk" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e8fe1-db64-46be-a858-c9cafd451fd7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvBsquJk'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14d3fb-19f6-4ce2-9dfa-f7dbfc6f3e31]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbba5e-86ff-44a7-930e-733b533b7e00]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:17 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f347e8-0eb2-4bfb-8984-fbe1d888aa0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260]
Nov 28 00:54:18 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:18 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589d385-2987-4684-894b-71ac21fd85f7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51b64d-d83c-44b1-95fe-96bb156dcf49]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:18 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:18 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:18 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c4d284-614a-44bd-b7fc-dfdf650f7450]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No VIF found with MAC fa:16:3e:3c:21:97, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:54:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.825s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== connect_volume: return (2512ms) {'type': 'block', 'scsi_wwn': '23634333132363636', 'path': '/dev/sdh'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634333132363636', 'path': '/dev/sdh'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-389395682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-389395682',id=31,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-iwojbrq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:03Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=500f7840-d86c-4620-b93f-9065ebe4872f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:54:19 user nova-compute[75266]:   <uuid>500f7840-d86c-4620-b93f-9065ebe4872f</uuid>
Nov 28 00:54:19 user nova-compute[75266]:   <name>instance-0000001f</name>
Nov 28 00:54:19 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:54:19 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:54:19 user nova-compute[75266]:   <metadata>
Nov 28 00:54:19 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:54:19 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-389395682</nova:name>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:54:16</nova:creationTime>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:54:19 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:54:19 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:owner>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:54:19 user nova-compute[75266]:       </nova:owner>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:54:19 user nova-compute[75266]:       <nova:ports>
Nov 28 00:54:19 user nova-compute[75266]:         <nova:port uuid="4b85a0a3-79a9-4e29-9559-5d25b03f7db5">
Nov 28 00:54:19 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:54:19 user nova-compute[75266]:         </nova:port>
Nov 28 00:54:19 user nova-compute[75266]:       </nova:ports>
Nov 28 00:54:19 user nova-compute[75266]:     </nova:instance>
Nov 28 00:54:19 user nova-compute[75266]:   </metadata>
Nov 28 00:54:19 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:54:19 user nova-compute[75266]:     <system>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="serial">500f7840-d86c-4620-b93f-9065ebe4872f</entry>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="uuid">500f7840-d86c-4620-b93f-9065ebe4872f</entry>
Nov 28 00:54:19 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:54:19 user nova-compute[75266]:     </system>
Nov 28 00:54:19 user nova-compute[75266]:   </sysinfo>
Nov 28 00:54:19 user nova-compute[75266]:   <os>
Nov 28 00:54:19 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:54:19 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:54:19 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:54:19 user nova-compute[75266]:   </os>
Nov 28 00:54:19 user nova-compute[75266]:   <features>
Nov 28 00:54:19 user nova-compute[75266]:     <acpi/>
Nov 28 00:54:19 user nova-compute[75266]:     <apic/>
Nov 28 00:54:19 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:54:19 user nova-compute[75266]:   </features>
Nov 28 00:54:19 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:54:19 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:54:19 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:54:19 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:54:19 user nova-compute[75266]:   </clock>
Nov 28 00:54:19 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:54:19 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:54:19 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:54:19 user nova-compute[75266]:   </cpu>
Nov 28 00:54:19 user nova-compute[75266]:   <devices>
Nov 28 00:54:19 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:54:19 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:19 user nova-compute[75266]:       <source dev="/dev/sdh"/>
Nov 28 00:54:19 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:54:19 user nova-compute[75266]:       <serial>a86af50f-7d6b-47e2-b25e-e6b6bc69d03b</serial>
Nov 28 00:54:19 user nova-compute[75266]:     </disk>
Nov 28 00:54:19 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:54:19 user nova-compute[75266]:       <mac address="fa:16:3e:d3:ca:9b"/>
Nov 28 00:54:19 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:54:19 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:54:19 user nova-compute[75266]:       <target dev="tap4b85a0a3-79"/>
Nov 28 00:54:19 user nova-compute[75266]:     </interface>
Nov 28 00:54:19 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:54:19 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/console.log" append="off"/>
Nov 28 00:54:19 user nova-compute[75266]:     </serial>
Nov 28 00:54:19 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:54:19 user nova-compute[75266]:     <video>
Nov 28 00:54:19 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:54:19 user nova-compute[75266]:     </video>
Nov 28 00:54:19 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:54:19 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:54:19 user nova-compute[75266]:     </rng>
Nov 28 00:54:19 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:54:19 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:54:19 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:54:19 user nova-compute[75266]:     </memballoon>
Nov 28 00:54:19 user nova-compute[75266]:   </devices>
Nov 28 00:54:19 user nova-compute[75266]: </domain>
Nov 28 00:54:19 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-389395682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-389395682',id=31,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-iwojbrq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:03Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=500f7840-d86c-4620-b93f-9065ebe4872f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG os_vif [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63558b53-d3b0-5bc0-9c9c-c376fc54b0e5', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b85a0a3-79, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b85a0a3-79, col_values=(('qos', UUID('dd78cdea-e2c5-4680-b8be-39448fc2ec8e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b85a0a3-79, col_values=(('external_ids', {'iface-id': '4b85a0a3-79a9-4e29-9559-5d25b03f7db5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ca:9b', 'vm-uuid': '500f7840-d86c-4620-b93f-9065ebe4872f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:19 user nova-compute[75266]: INFO os_vif [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79')
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:d3:ca:9b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:54:19 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:20 user nova-compute[75266]: WARNING nova.compute.manager [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state building and task_state spawning.
Nov 28 00:54:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:22 user nova-compute[75266]: INFO nova.compute.manager [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attaching volume ec67af19-1729-43e1-ba13-129c8a46e33f to /dev/vdc
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ce560e-c2c1-44a0-b30b-585e6fb98d22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db40ef5-3ceb-4669-887f-acb91e1b88d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2967f-775b-41ed-9817-fa65457f0d01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2128b054-7e37-4ad2-aea9-a7802dbc96dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:22 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[98df9a2a-642e-430c-a1a1-d94e63b5cfb9]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating existing volume attachment record: 23aacac9-4867-4bc1-b6aa-c59d693e98c8 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:54:22 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance spawned successfully.
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:54:22 user nova-compute[75266]: INFO nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:22 user nova-compute[75266]: WARNING nova.compute.manager [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state building and task_state spawning.
Nov 28 00:54:22 user nova-compute[75266]: INFO nova.compute.manager [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Took 20.52 seconds to build instance.
Nov 28 00:54:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.617s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7067MB free_disk=25.09044647216797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:54:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OelhtNMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:30 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:30 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:30 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:54:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd879e51-ea18-42e9-9bae-47836419ed11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:54:31 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eedb9e1-0277-43b2-9af2-03ee7d0f4ded]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f] added
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17018ed-2fac-43af-b1fb-e6147fe3c8bb]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780824e-413f-4792-8fa2-53615428d20d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OelhtNMB {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OelhtNMB" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[decaae8c-2707-4174-8281-144fdba13798]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OelhtNMB'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fa5f2c-5e46-438a-9b33-ab226fa8fe93]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1607b0e-4f12-400a-8368-9046b1a36f02]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd14ec-920b-477d-b1e3-fe1d18b00399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260]
Nov 28 00:54:31 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa0641-f78d-4285-bfb1-da1d73e123ac]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b75ed13-ed1a-43fe-8c92-ab00ad580cb6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:31 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e44b0-6e95-41f2-a20d-9c86c85da659]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:54:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OelhtNMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23039386266366562', 'path': '/dev/sdi'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039386266366562', 'path': '/dev/sdi'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:54:32 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:32 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:54:32 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 00:54:32 user nova-compute[75266]:   <serial>ec67af19-1729-43e1-ba13-129c8a46e33f</serial>
Nov 28 00:54:32 user nova-compute[75266]: </disk>
Nov 28 00:54:32 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] No VIF found with MAC fa:16:3e:3c:21:97, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.568s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:33 user nova-compute[75266]: INFO nova.compute.manager [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Detaching volume 96cca523-fcec-4118-9da5-3cd8302ca3eb
Nov 28 00:54:33 user nova-compute[75266]: INFO nova.virt.block_device [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attempting to driver detach volume 96cca523-fcec-4118-9da5-3cd8302ca3eb from mountpoint /dev/vdb
Nov 28 00:54:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Attempting to detach device vdb from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:54:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:54:33 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:33 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:54:33 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:54:33 user nova-compute[75266]:   <serial>96cca523-fcec-4118-9da5-3cd8302ca3eb</serial>
Nov 28 00:54:33 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:54:33 user nova-compute[75266]: </disk>
Nov 28 00:54:33 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:54:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdb from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the persistent domain config.
Nov 28 00:54:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:54:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:54:33 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:33 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:54:33 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:54:33 user nova-compute[75266]:   <serial>96cca523-fcec-4118-9da5-3cd8302ca3eb</serial>
Nov 28 00:54:33 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:54:33 user nova-compute[75266]: </disk>
Nov 28 00:54:33 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:54:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:54:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing instance network info cache due to event network-changed-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Refreshing network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated VIF entry in instance network info cache for port e6fc4f41-e0f9-4d3e-9361-e29c116e19ef. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:54 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b is timed out.
Nov 28 00:54:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdb from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the live domain config.
Nov 28 00:54:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkDRJZpt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[be785a68-d1c5-4b5b-a0f6-aeb1b703bd1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:54:54 user nova-compute[75266]: No targets found.
Nov 28 00:54:54 user nova-compute[75266]: iSNS:
Nov 28 00:54:54 user nova-compute[75266]: No targets found.
Nov 28 00:54:54 user nova-compute[75266]: STATIC:
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d
Nov 28 00:54:54 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:54 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:54 user nova-compute[75266]: FIRMWARE:
Nov 28 00:54:54 user nova-compute[75266]: No targets found.
Nov 28 00:54:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:54:54 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:54:54 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a5c525-4a8a-45eb-a198-bb9365e72176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecfe4a2-1fd3-4a38-82ee-a58ce4a35117]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:54 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c21c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a00a2a4-21ac-4deb-a53d-2c3660bfc3a4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e066dfa3-a0d0-42b7-a18c-f55d874d5328]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9a9b8-088a-4152-9747-e1ad12bcb1d7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8297e94a-3d3d-4777-9611-786f7945c15b]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81be5a9-3c7a-4f68-a24a-406103238286]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[917006c8-9cc5-4476-b510-9fb92d77f853]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260]
Nov 28 00:54:54 user nova-compute[75266]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96cca523-fcec-4118-9da5-3cd8302ca3eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e116d-7f2e-4f8c-9f0c-632a37759887]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== disconnect_volume: return (375ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing instance network info cache due to event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updated VIF entry in instance network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-changed-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Refreshing instance network info cache due to event network-changed-2f437b2e-0b70-4d62-8011-839cbc9a06bb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Refreshing network info cache for port 2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Stashing vm_state: active {{(pid=75266) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:54:55 user nova-compute[75266]: INFO nova.compute.claims [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Claim successful on node user
Nov 28 00:54:55 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating resource usage from migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updated VIF entry in instance network info cache for port 2f437b2e-0b70-4d62-8011-839cbc9a06bb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:54:56 user nova-compute[75266]: INFO nova.compute.manager [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Detaching volume ec67af19-1729-43e1-ba13-129c8a46e33f
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.566s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:56 user nova-compute[75266]: INFO nova.compute.manager [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Migrating
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:54:56 user nova-compute[75266]: INFO nova.virt.block_device [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Attempting to driver detach volume ec67af19-1729-43e1-ba13-129c8a46e33f from mountpoint /dev/vdc
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Attempting to detach device vdc from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:54:56 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:56 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:54:56 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 00:54:56 user nova-compute[75266]:   <serial>ec67af19-1729-43e1-ba13-129c8a46e33f</serial>
Nov 28 00:54:56 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 00:54:56 user nova-compute[75266]: </disk>
Nov 28 00:54:56 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:54:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdc from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the persistent domain config.
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:54:56 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:54:56 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:54:56 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 00:54:56 user nova-compute[75266]:   <serial>ec67af19-1729-43e1-ba13-129c8a46e33f</serial>
Nov 28 00:54:56 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 00:54:56 user nova-compute[75266]: </disk>
Nov 28 00:54:56 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Starting migrate_disk_and_power_off {{(pid=75266) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:57 user nova-compute[75266]: WARNING nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state active and task_state resize_migrating.
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:57 user nova-compute[75266]: WARNING nova.compute.manager [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state active and task_state resize_migrating.
Nov 28 00:54:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance destroyed successfully.
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f437b2e-0b, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd6849bb-8c57-4f77-8502-6b33426534a2) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:57 user nova-compute[75266]: INFO os_vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b')
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:57 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855039f-8a10-47bf-be81-c2880720b3a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:54:57 user nova-compute[75266]: No targets found.
Nov 28 00:54:57 user nova-compute[75266]: iSNS:
Nov 28 00:54:57 user nova-compute[75266]: No targets found.
Nov 28 00:54:57 user nova-compute[75266]: STATIC:
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d
Nov 28 00:54:57 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:54:57 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:54:57 user nova-compute[75266]: FIRMWARE:
Nov 28 00:54:57 user nova-compute[75266]: No targets found.
Nov 28 00:54:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:54:57 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:54:57 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034b57a-77ea-45a2-ab33-c741aa46dd67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32ce66c-915e-4725-8488-e146974256b0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:54:57 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:54:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c59eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2cefea-f744-4339-84e3-f026be507c5a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1869363a-72de-4e76-a4aa-a265bb1b5ddf]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4ae24-966c-426e-b35f-91c406fea433]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d6ef6-b82b-4b9e-84ff-4b786f216c17]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObc19312b-600533580860fb90', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bc19312b', '/dev/disk/by-id/scsi-23630303533333538') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391d09b-ecf5-44c7-9cd0-67691c94c75e]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76937d2-704b-42c6-bc0f-6388770f1243]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d1e5ea-5f00-47d3-aff5-c1a7930b20b2]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]
Nov 28 00:54:57 user nova-compute[75266]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.
Nov 28 00:54:57 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd01061-a657-4e1f-bdb3-ac8be24584aa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== disconnect_volume: return (360ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:54:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:58 user nova-compute[75266]: INFO nova.compute.manager [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Shelving
Nov 28 00:54:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Port 2f437b2e-0b70-4d62-8011-839cbc9a06bb binding to destination host user is already ACTIVE {{(pid=75266) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:54:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance destroyed successfully.
Nov 28 00:54:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Beginning cold snapshot process
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk /opt/stack/data/nova/instances/snapshots/tmpwqjrvc34/59a1134f79e94086bda3360c09b26be7 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:59 user nova-compute[75266]: WARNING nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:54:59 user nova-compute[75266]: WARNING nova.compute.manager [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 00:54:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG os_brick.utils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[615ed1a4-410e-4bea-8d55-2c20c7ea91c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e12386-0a1c-4f4c-b91c-31913d58b9a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1db864-b019-4345-b99c-b2ab51e7b819]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[66718e25-3e61-4aca-a49b-78fd27cace93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:54:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:55:00 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:55:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dfb0f7-fd61-43b2-a363-45d904c3604b]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk /opt/stack/data/nova/instances/snapshots/tmpwqjrvc34/59a1134f79e94086bda3360c09b26be7" returned: 0 in 1.158s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:00 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Snapshot extracted, beginning image upload
Nov 28 00:55:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Snapshot image upload complete
Nov 28 00:55:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:55:03 user nova-compute[75266]: INFO nova.compute.manager [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Shelve offloading
Nov 28 00:55:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance destroyed successfully.
Nov 28 00:55:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:55:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:55:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance destroyed successfully.
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'resources' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpUFquDeumIIdDQAaGyNyeGGAa5cfVSI7FFpRzGGGZzYV4GV1jUbn8wjNU0WSYASKLUcvewvIMnW8sX+yZuTGWUBWmFHdYqYTml4tXyMStLNULR7tj9BXfQY6FltgCdBQ==',key_name='tempest-keypair-1702320399',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T00:55:03.427161',shelved_host='user',shelved_image_id='5e9be70d-44ff-4bb9-af6f-56c6ac78550a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG os_vif [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea295632-a1, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aaff6596-101c-43d7-a70c-f53c02c41810) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing instance network info cache due to event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.network.neutron [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:04 user nova-compute[75266]: INFO os_vif [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1')
Nov 28 00:55:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Deleting instance files /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e_del
Nov 28 00:55:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Deletion of /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e_del complete
Nov 28 00:55:04 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Deleted allocations for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e
Nov 28 00:55:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.objects.base [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<5fcab10a-4f5f-479c-9d0c-907bcea7d87e> lazy-loaded attributes: resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.network.neutron [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updated VIF entry in instance network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG nova.network.neutron [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapea295632-a1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:05 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:55:05 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:55:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.716s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Starting finish_migration {{(pid=75266) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:55:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Creating image(s)
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Ensure instance console log exists: /opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start _get_guest_xml network_info=[{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08844c7b-f7ca-4c50-ac58-eccff6064ec4', 'attached_at': '2023-11-28T00:55:07.000000', 'detached_at': '', 'volume_id': 'cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'serial': 'cbf2ecb0-05e5-411a-9dfb-33928d958c2c'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '3f0de267-85f5-4e1f-94ef-40ec99e18ffa', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:55:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:07 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a93e6-056b-49c3-94ec-e993d11e5e06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:55:07 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4e634-8877-4d62-92cc-a6fe1c62a96f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c] added
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f7b5f-ae30-413e-ae66-7b431dfe57cf]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d555335-03a8-485a-a5f3-5b20a74302fd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShpULPrK {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ShpULPrK" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e6314e-7fe9-4377-bae4-5734e8444eee]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ShpULPrK'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe2e813-d16c-4bd3-b5cc-ea1fa9ea4795]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098b890-4531-42d2-8223-08f4e15edd41]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.214s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e265df-9e78-4029-87d6-5cad7d7f7148]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]
Nov 28 00:55:07 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c7367-e7f3-4232-a37f-1dd0610ff4a6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc202f-370d-4a98-af4f-622b58bb3654]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56784b28-a57a-44ae-ae9f-9f774aa143bb]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:55:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23630303533333538', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630303533333538', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:55:08 user nova-compute[75266]:   <uuid>08844c7b-f7ca-4c50-ac58-eccff6064ec4</uuid>
Nov 28 00:55:08 user nova-compute[75266]:   <name>instance-0000001b</name>
Nov 28 00:55:08 user nova-compute[75266]:   <memory>2097152</memory>
Nov 28 00:55:08 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:55:08 user nova-compute[75266]:   <metadata>
Nov 28 00:55:08 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:55:08 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:55:08 user nova-compute[75266]:       <nova:name>tempest-ServerActionsTestOtherA-server-965644235</nova:name>
Nov 28 00:55:08 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:55:07</nova:creationTime>
Nov 28 00:55:08 user nova-compute[75266]:       <nova:flavor name="m1.small">
Nov 28 00:55:08 user nova-compute[75266]:         <nova:memory>2048</nova:memory>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:disk>20</nova:disk>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:55:08 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:55:08 user nova-compute[75266]:       <nova:owner>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:user uuid="f63a0e9261934c8b8e673f069c3376bd">tempest-ServerActionsTestOtherA-277302336-project-member</nova:user>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:project uuid="22c31829ff0846fc8584d492bea6cdc4">tempest-ServerActionsTestOtherA-277302336</nova:project>
Nov 28 00:55:08 user nova-compute[75266]:       </nova:owner>
Nov 28 00:55:08 user nova-compute[75266]:       <nova:ports>
Nov 28 00:55:08 user nova-compute[75266]:         <nova:port uuid="2f437b2e-0b70-4d62-8011-839cbc9a06bb">
Nov 28 00:55:08 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:55:08 user nova-compute[75266]:         </nova:port>
Nov 28 00:55:08 user nova-compute[75266]:       </nova:ports>
Nov 28 00:55:08 user nova-compute[75266]:     </nova:instance>
Nov 28 00:55:08 user nova-compute[75266]:   </metadata>
Nov 28 00:55:08 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:55:08 user nova-compute[75266]:     <system>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="serial">08844c7b-f7ca-4c50-ac58-eccff6064ec4</entry>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="uuid">08844c7b-f7ca-4c50-ac58-eccff6064ec4</entry>
Nov 28 00:55:08 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:55:08 user nova-compute[75266]:     </system>
Nov 28 00:55:08 user nova-compute[75266]:   </sysinfo>
Nov 28 00:55:08 user nova-compute[75266]:   <os>
Nov 28 00:55:08 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:55:08 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:55:08 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:55:08 user nova-compute[75266]:   </os>
Nov 28 00:55:08 user nova-compute[75266]:   <features>
Nov 28 00:55:08 user nova-compute[75266]:     <acpi/>
Nov 28 00:55:08 user nova-compute[75266]:     <apic/>
Nov 28 00:55:08 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:55:08 user nova-compute[75266]:   </features>
Nov 28 00:55:08 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:55:08 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:55:08 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:55:08 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:55:08 user nova-compute[75266]:   </clock>
Nov 28 00:55:08 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:55:08 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:55:08 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:55:08 user nova-compute[75266]:   </cpu>
Nov 28 00:55:08 user nova-compute[75266]:   <devices>
Nov 28 00:55:08 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:55:08 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:08 user nova-compute[75266]:       <source dev="/dev/sde"/>
Nov 28 00:55:08 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:55:08 user nova-compute[75266]:       <serial>cbf2ecb0-05e5-411a-9dfb-33928d958c2c</serial>
Nov 28 00:55:08 user nova-compute[75266]:     </disk>
Nov 28 00:55:08 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:55:08 user nova-compute[75266]:       <mac address="fa:16:3e:6d:ab:83"/>
Nov 28 00:55:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:55:08 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:55:08 user nova-compute[75266]:       <target dev="tap2f437b2e-0b"/>
Nov 28 00:55:08 user nova-compute[75266]:     </interface>
Nov 28 00:55:08 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:55:08 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4/console.log" append="off"/>
Nov 28 00:55:08 user nova-compute[75266]:     </serial>
Nov 28 00:55:08 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:55:08 user nova-compute[75266]:     <video>
Nov 28 00:55:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:55:08 user nova-compute[75266]:     </video>
Nov 28 00:55:08 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:55:08 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:55:08 user nova-compute[75266]:     </rng>
Nov 28 00:55:08 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:55:08 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:55:08 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:55:08 user nova-compute[75266]:     </memballoon>
Nov 28 00:55:08 user nova-compute[75266]:   </devices>
Nov 28 00:55:08 user nova-compute[75266]: </domain>
Nov 28 00:55:08 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-213784539-network", "vif_mac": "fa:16:3e:6d:ab:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG os_vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a321591e-a468-5e77-9098-5fda1d1966d6', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f437b2e-0b, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f437b2e-0b, col_values=(('qos', UUID('4ded3bd5-cbbb-401c-99c6-64aed4d4dda1')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f437b2e-0b, col_values=(('external_ids', {'iface-id': '2f437b2e-0b70-4d62-8011-839cbc9a06bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:ab:83', 'vm-uuid': '08844c7b-f7ca-4c50-ac58-eccff6064ec4'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:55:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:09 user nova-compute[75266]: INFO os_vif [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b')
Nov 28 00:55:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:55:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] No VIF found with MAC fa:16:3e:6d:ab:83, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:10 user nova-compute[75266]: WARNING nova.compute.manager [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state active and task_state resize_finish.
Nov 28 00:55:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:55:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance running successfully.
Nov 28 00:55:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Failed to set time: agent not configured {{(pid=75266) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] finish_migration finished successfully. {{(pid=75266) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:12 user nova-compute[75266]: WARNING nova.compute.manager [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state resized and task_state None.
Nov 28 00:55:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:16 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b is timed out.
Nov 28 00:55:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully detached device vdc from instance f480b3d7-0357-4dca-af75-d4cd264f5a2b from the live domain config.
Nov 28 00:55:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OelhtNMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:16 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d4dde-bbbd-4ca4-9f0f-37b834d43662]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:55:16 user nova-compute[75266]: No targets found.
Nov 28 00:55:16 user nova-compute[75266]: iSNS:
Nov 28 00:55:16 user nova-compute[75266]: No targets found.
Nov 28 00:55:16 user nova-compute[75266]: STATIC:
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d
Nov 28 00:55:16 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:16 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:16 user nova-compute[75266]: FIRMWARE:
Nov 28 00:55:16 user nova-compute[75266]: No targets found.
Nov 28 00:55:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:55:16 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:55:16 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[21269370-5855-4f58-bf3c-120a0ee74531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9fc3f0-f70f-4f77-8afc-e78b4b089412]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f (non-flash)
Nov 28 00:55:16 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:16 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c15add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f'): ({'sdi'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Removing single pathed devices sdi {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1c8fc-dfdf-450f-9d55-54d4120cf756]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7aa294-6908-423d-ae8d-673ab2ba523c]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flushing IO for device /dev/sdi {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a917407a-3232-4ed0-b539-5315c9d4e4a0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f73c7a9-327f-4ff0-8404-91070f5f1573]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:55:16 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74ee70-cb8f-473b-87a3-3f3b990776f4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[26380088-03a6-4db7-ba84-3d5420d9acc7]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260]
Nov 28 00:55:17 user nova-compute[75266]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec67af19-1729-43e1-ba13-129c8a46e33f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02db73-f3e2-420e-8328-453b296b2ab2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] <== disconnect_volume: return (360ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:55:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'flavor' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 00:55:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:19 user nova-compute[75266]: INFO nova.compute.manager [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Terminating instance
Nov 28 00:55:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-unplugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] No waiting events found dispatching network-vif-unplugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-unplugged-2e30b84a-0f54-4293-95c7-339ccf7e830b for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:55:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Instance destroyed successfully.
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'resources' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-222044104',display_name='tempest-AttachVolumeTestJSON-server-222044104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-222044104',id=26,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY2yzXm9tZGORAhgNmaczx9c+rm3QJjw8ARnx9lTlGqslv2Ded4yePiXHnC6v2wifPYeRqtHuEizTVtpjDOgsHDMsy8qhgWlqGPhwyajoZpjJ1i59I04C6u7dohvS8F3w==',key_name='tempest-keypair-1111325301',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf38cc0048d41bfb69a50d55f9c1963',ramdisk_id='',reservation_id='r-0bosuggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1794071981',owner_user_name='tempest-AttachVolumeTestJSON-1794071981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cf2b106f48442cd84784a5880737464',uuid=f480b3d7-0357-4dca-af75-d4cd264f5a2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converting VIF {"id": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "address": "fa:16:3e:3c:21:97", "network": {"id": "7548b01b-c93b-4351-a955-67633111ec0c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-549107071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf38cc0048d41bfb69a50d55f9c1963", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e30b84a-0f", "ovs_interfaceid": "2e30b84a-0f54-4293-95c7-339ccf7e830b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG os_vif [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e30b84a-0f, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=364cfe8f-a037-4651-b164-6744d9418cd4) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:20 user nova-compute[75266]: INFO os_vif [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:21:97,bridge_name='br-int',has_traffic_filtering=True,id=2e30b84a-0f54-4293-95c7-339ccf7e830b,network=Network(7548b01b-c93b-4351-a955-67633111ec0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e30b84a-0f')
Nov 28 00:55:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Deleting instance files /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b_del
Nov 28 00:55:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Deletion of /opt/stack/data/nova/instances/f480b3d7-0357-4dca-af75-d4cd264f5a2b_del complete
Nov 28 00:55:20 user nova-compute[75266]: INFO nova.compute.manager [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 00:55:20 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:55:20 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:21 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Took 0.93 seconds to deallocate network for instance.
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-deleted-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:21 user nova-compute[75266]: INFO nova.compute.manager [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Neutron deleted interface 2e30b84a-0f54-4293-95c7-339ccf7e830b; detaching it from the instance and deleting it from the info cache
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Detach interface failed, port_id=2e30b84a-0f54-4293-95c7-339ccf7e830b, reason: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:21 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Deleted allocations for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing instance network info cache due to event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Acquiring lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Acquired lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:55:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Acquiring lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Lock "f480b3d7-0357-4dca-af75-d4cd264f5a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] No waiting events found dispatching network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:22 user nova-compute[75266]: WARNING nova.compute.manager [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Received unexpected event network-vif-plugged-2e30b84a-0f54-4293-95c7-339ccf7e830b for instance with vm_state deleted and task_state None.
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updated VIF entry in instance network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Releasing lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:22 user nova-compute[75266]: INFO nova.compute.manager [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Attaching volume 20f2e1ca-37cc-463c-a6d9-51154a0664be to /dev/vdb
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea9375-2df0-4ca3-9a23-cd7060c56b85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8cc66-4cdf-4787-a80a-87a22b31da2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90af162-3723-4277-8c07-85dd70752980]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff4dc5e-1051-43c6-b906-3bd941d742d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:55:22 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b2d7bd-7c1f-4540-9ede-2d2bc4814021]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating existing volume attachment record: e2821b69-c3f6-4ab1-bff2-647723b19ddd {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:55:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=25.09295654296875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Applying migration context for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 as it has an incoming, in-progress migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e. Migration status is finished {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 00:55:26 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating resource usage from migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 41828b32-f570-4428-8064-5c199a898a04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:55:26 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:55:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:55:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:55:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:55:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 41828b32-f570-4428-8064-5c199a898a04] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:29 user nova-compute[75266]: INFO nova.compute.manager [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Terminating instance
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [{"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-41828b32-f570-4428-8064-5c199a898a04" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-unplugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPJIlDae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:30 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:30 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:30 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5ec5b-1b7c-4d9e-99d5-0d6303fc34e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:55:30 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b32bf-d044-4385-afe0-51d9aa3b48a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be] added
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ccc744-60b2-4c56-98ee-d5b8de77b87d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae385b1-bbc6-4a02-b587-30bd2e498a31]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPJIlDae {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPJIlDae" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6320ff-0a3c-4fab-9bd6-7ecfe885180d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPJIlDae'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[240e8513-afee-4b1e-8d6d-e7d0a17b4649]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2558c-d3f1-449d-add3-008ce55acebe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b6931-f725-4afb-9ee5-5a36a2466545]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260]
Nov 28 00:55:30 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Instance destroyed successfully.
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.objects.instance [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lazy-loading 'resources' on Instance uuid 41828b32-f570-4428-8064-5c199a898a04 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1577106707',display_name='tempest-ServerActionsTestOtherB-server-1577106707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1577106707',id=18,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg==',key_name='tempest-keypair-1863538692',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b57f21cfce3044c5aad7192a64ce2d8a',ramdisk_id='',reservation_id='r-wt46c80s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1824523225',owner_user_name='tempest-ServerActionsTestOtherB-1824523225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e626332697e34a0ba733c723a5ecb328',uuid=41828b32-f570-4428-8064-5c199a898a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converting VIF {"id": "9c1755ff-555e-44fa-8082-fceddb0ee343", "address": "fa:16:3e:e3:c0:e9", "network": {"id": "e01edb42-6b5b-4b41-af5f-489ab4269136", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-208434077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b57f21cfce3044c5aad7192a64ce2d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1755ff-55", "ovs_interfaceid": "9c1755ff-555e-44fa-8082-fceddb0ee343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_vif [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b780d9b9-c0b6-43a6-9a51-6e76829d2471]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1755ff-55, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dede40c-7a6e-4f4e-b94f-ba1f7b25d952) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:30 user nova-compute[75266]: INFO os_vif [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c0:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c1755ff-555e-44fa-8082-fceddb0ee343,network=Network(e01edb42-6b5b-4b41-af5f-489ab4269136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1755ff-55')
Nov 28 00:55:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGKstYvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:30 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53f5653-d1bb-49c0-bc51-91afd9ba0758]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:30 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:30 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0195dfe-82d7-42d5-8b50-13fab9882c17]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPJIlDae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:55:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26362626430646332', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362626430646332', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.045s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd7aa0-9b7f-475b-9658-baaffde8f44c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:55:31 user nova-compute[75266]: No targets found.
Nov 28 00:55:31 user nova-compute[75266]: iSNS:
Nov 28 00:55:31 user nova-compute[75266]: No targets found.
Nov 28 00:55:31 user nova-compute[75266]: STATIC:
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d
Nov 28 00:55:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:31 user nova-compute[75266]: FIRMWARE:
Nov 28 00:55:31 user nova-compute[75266]: No targets found.
Nov 28 00:55:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:55:31 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:55:31 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:55:31 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:31 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:55:31 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:55:31 user nova-compute[75266]:   <serial>20f2e1ca-37cc-463c-a6d9-51154a0664be</serial>
Nov 28 00:55:31 user nova-compute[75266]: </disk>
Nov 28 00:55:31 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d57c4-0983-4e56-ba36-68d261a44f8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a9e3d-d0f5-4ff5-9c72-eb8fe376bfe0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:31 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bac167250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0289e05a-ade1-4d05-afda-44299ee2ad08]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef363ef5-1e11-4568-9ad3-2bcb75ab96cd]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21c2c0-b894-4086-87f8-5b5714427449]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e7d28-ae17-4f79-9ce4-a1b9b7c47bfe]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9140bde-bd99-43c3-8cc1-f151f2752f30]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e59a4f-abbb-4db4-b8da-8e00f912c206]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260]
Nov 28 00:55:31 user nova-compute[75266]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:307a1ca3-5fc8-4700-849a-6b2cbcacd748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ed15b-ee8e-466f-9277-b2fa994e775f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] <== disconnect_volume: return (1373ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:55:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Deleting instance files /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_del
Nov 28 00:55:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Deletion of /opt/stack/data/nova/instances/41828b32-f570-4428-8064-5c199a898a04_del complete
Nov 28 00:55:31 user nova-compute[75266]: INFO nova.compute.manager [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Took 2.25 seconds to destroy the instance on the hypervisor.
Nov 28 00:55:31 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:55:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No VIF found with MAC fa:16:3e:cd:cd:ab, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Acquiring lock "41828b32-f570-4428-8064-5c199a898a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Lock "41828b32-f570-4428-8064-5c199a898a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] No waiting events found dispatching network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:32 user nova-compute[75266]: WARNING nova.compute.manager [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received unexpected event network-vif-plugged-9c1755ff-555e-44fa-8082-fceddb0ee343 for instance with vm_state active and task_state deleting.
Nov 28 00:55:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.612s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:32 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:32 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 41828b32-f570-4428-8064-5c199a898a04] Took 0.73 seconds to deallocate network for instance.
Nov 28 00:55:33 user nova-compute[75266]: INFO nova.compute.manager [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 00:55:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:33 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:55:33 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:55:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:33 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Deleted allocations for instance 41828b32-f570-4428-8064-5c199a898a04
Nov 28 00:55:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "41828b32-f570-4428-8064-5c199a898a04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.261s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] [instance: 41828b32-f570-4428-8064-5c199a898a04] Received event network-vif-deleted-9c1755ff-555e-44fa-8082-fceddb0ee343 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:35 user nova-compute[75266]: INFO nova.compute.manager [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Detaching volume 20f2e1ca-37cc-463c-a6d9-51154a0664be
Nov 28 00:55:35 user nova-compute[75266]: INFO nova.virt.block_device [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Attempting to driver detach volume 20f2e1ca-37cc-463c-a6d9-51154a0664be from mountpoint /dev/vdb
Nov 28 00:55:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Attempting to detach device vdb from instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:55:35 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:35 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:55:35 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:55:35 user nova-compute[75266]:   <serial>20f2e1ca-37cc-463c-a6d9-51154a0664be</serial>
Nov 28 00:55:35 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:55:35 user nova-compute[75266]: </disk>
Nov 28 00:55:35 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:55:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully detached device vdb from instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 from the persistent domain config.
Nov 28 00:55:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:55:35 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:35 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:55:35 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:55:35 user nova-compute[75266]:   <serial>20f2e1ca-37cc-463c-a6d9-51154a0664be</serial>
Nov 28 00:55:35 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:55:35 user nova-compute[75266]: </disk>
Nov 28 00:55:35 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:55:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-changed-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing instance network info cache due to event network-changed-2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:55:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updated VIF entry in instance network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:43 user nova-compute[75266]: INFO nova.compute.manager [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Detaching volume 685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:55:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:43 user nova-compute[75266]: INFO nova.virt.block_device [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Attempting to driver detach volume 685d49b1-0ae7-4bd5-8960-edfa41570827 from mountpoint /dev/vdb
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Attempting to detach device vdb from instance a835216a-04a1-4660-a458-13cca79489c3 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:55:43 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:43 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:55:43 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:55:43 user nova-compute[75266]:   <serial>685d49b1-0ae7-4bd5-8960-edfa41570827</serial>
Nov 28 00:55:43 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:55:43 user nova-compute[75266]: </disk>
Nov 28 00:55:43 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:55:43 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully detached device vdb from instance a835216a-04a1-4660-a458-13cca79489c3 from the persistent domain config.
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a835216a-04a1-4660-a458-13cca79489c3 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:55:43 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:43 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 00:55:43 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:55:43 user nova-compute[75266]:   <serial>685d49b1-0ae7-4bd5-8960-edfa41570827</serial>
Nov 28 00:55:43 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:55:43 user nova-compute[75266]: </disk>
Nov 28 00:55:43 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:55:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:44 user nova-compute[75266]: INFO nova.compute.manager [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Terminating instance
Nov 28 00:55:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-changed-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing instance network info cache due to event network-changed-2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Acquiring lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Acquired lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG nova.network.neutron [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Refreshing network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updated VIF entry in instance network info cache for port 2df0bea2-3afd-4093-909a-2d0026656990. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.network.neutron [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [{"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Releasing lock "refresh_cache-a835216a-04a1-4660-a458-13cca79489c3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Instance destroyed successfully.
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.objects.instance [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid 9d7f368b-5aca-4be6-8844-a207bee693b2 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1752779599',display_name='tempest-TestVolumeBootPattern-server-1752779599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1752779599',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-gmkl99rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:54:14Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=9d7f368b-5aca-4be6-8844-a207bee693b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "address": "fa:16:3e:b9:80:a4", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4c074f-c4", "ovs_interfaceid": "ad4c074f-c4eb-44e5-af60-5d63c0776018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_vif [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4c074f-c4, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba07e0a7-8124-434f-8131-4526e5d7d585) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:45 user nova-compute[75266]: INFO os_vif [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:a4,bridge_name='br-int',has_traffic_filtering=True,id=ad4c074f-c4eb-44e5-af60-5d63c0776018,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4c074f-c4')
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFmanBSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:45 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[533718bf-b5a7-44e7-acea-e043bb1ffb76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:55:45 user nova-compute[75266]: No targets found.
Nov 28 00:55:45 user nova-compute[75266]: iSNS:
Nov 28 00:55:45 user nova-compute[75266]: No targets found.
Nov 28 00:55:45 user nova-compute[75266]: STATIC:
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d
Nov 28 00:55:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:45 user nova-compute[75266]: FIRMWARE:
Nov 28 00:55:45 user nova-compute[75266]: No targets found.
Nov 28 00:55:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:55:45 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:55:45 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d26c70-3e2a-4fdd-96a1-3a4ab68b65e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cb397-39b8-43a1-b55c-65fe14948767]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:45 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c3d03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[937ca6a1-5e28-4411-b8bf-287be2bf946e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ada357-2213-42f2-841c-d776bfbbc08f]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e365c-9e28-4bcd-b7c1-2fd1aeb21eb0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea921f50-8ff3-461b-87fa-f00a247e11b7]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO19873099-617d7e669192fe4f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_19873099', '/dev/disk/by-id/scsi-23631376437653636') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[13987ccc-db40-4685-9f3b-d060b5300197]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bab723-67ea-4483-9bd4-5ae2e23ad4f4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb28eb-b632-4d5d-bb98-34a851019616]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260]
Nov 28 00:55:45 user nova-compute[75266]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0878e47-41b4-44a6-b327-3481eae2484d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8781d1-0505-4514-987b-ad60fff137f5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (329ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:55:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Deleting instance files /opt/stack/data/nova/instances/9d7f368b-5aca-4be6-8844-a207bee693b2_del
Nov 28 00:55:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Deletion of /opt/stack/data/nova/instances/9d7f368b-5aca-4be6-8844-a207bee693b2_del complete
Nov 28 00:55:46 user nova-compute[75266]: INFO nova.compute.manager [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 28 00:55:46 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:55:46 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:55:46 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:55:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:46 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:46 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Took 0.38 seconds to deallocate network for instance.
Nov 28 00:55:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-deleted-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-unplugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] No waiting events found dispatching network-vif-unplugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-unplugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Acquiring lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] No waiting events found dispatching network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:47 user nova-compute[75266]: WARNING nova.compute.manager [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Received unexpected event network-vif-plugged-ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance with vm_state active and task_state deleting.
Nov 28 00:55:47 user nova-compute[75266]: INFO nova.compute.manager [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Deleting volume: b0878e47-41b4-44a6-b327-3481eae2484d {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:47 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance 9d7f368b-5aca-4be6-8844-a207bee693b2
Nov 28 00:55:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "9d7f368b-5aca-4be6-8844-a207bee693b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.992s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:53 user nova-compute[75266]: INFO nova.compute.manager [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Rescuing
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating instance_info_cache with network_info: [{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:53 user nova-compute[75266]: WARNING nova.compute.manager [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state rescuing.
Nov 28 00:55:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance destroyed successfully.
Nov 28 00:55:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Attempting a stable device rescue
Nov 28 00:55:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 00:55:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Creating image(s)
Nov 28 00:55:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'trusted_certs' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG nova.virt.images [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 514ac427-1da5-4fb2-9ecc-27393cb575fb was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.part /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 is timed out.
Nov 28 00:55:55 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully detached device vdb from instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 from the live domain config.
Nov 28 00:55:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPJIlDae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:55 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[844be6cd-4784-459b-b7d9-c3c8c18427ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:55:55 user nova-compute[75266]: No targets found.
Nov 28 00:55:55 user nova-compute[75266]: iSNS:
Nov 28 00:55:55 user nova-compute[75266]: No targets found.
Nov 28 00:55:55 user nova-compute[75266]: STATIC:
Nov 28 00:55:55 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:55:55 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:55 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:55 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:55:55 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:55 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:55 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:55:55 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:55 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:55 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be
Nov 28 00:55:55 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:55 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:55 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:55:55 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:55:55 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:55:55 user nova-compute[75266]: FIRMWARE:
Nov 28 00:55:55 user nova-compute[75266]: No targets found.
Nov 28 00:55:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:55:55 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:55:55 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f2a231-7ea5-4047-849b-2b030db99aad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb5484-2b86-418f-974f-b217beff115e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:55 user nova-compute[75266]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be (non-flash)
Nov 28 00:55:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c3f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171b37b-f0e5-4d52-a939-72c0fb77c53c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6497055-e0b2-4395-a723-f18b62f1f836]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a622bd24-69f8-4ca2-a22b-1471d0d1f759]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.076s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ab1a7-7865-4750-9d8f-eb5aa46c89bc]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[891457f2-352a-4a6c-9def-b5e55adfdf23]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:56 user nova-compute[75266]: WARNING nova.compute.manager [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state rescuing.
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79094273-0096-4e78-bd57-eecfcbd618e4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260]
Nov 28 00:55:56 user nova-compute[75266]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be, portal: 172.16.0.220,3260] successful.
Nov 28 00:55:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.part /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.converted" returned: 0 in 0.550s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20f2e1ca-37cc-463c-a6d9-51154a0664be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb356d5f-d0a9-4d6e-922a-c909baef8ca8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.561s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== disconnect_volume: return (563ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.942s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370 --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370,backing_fmt=raw /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370,backing_fmt=raw /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue" returned: 0 in 0.048s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'migration_context' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<500f7840-d86c-4620-b93f-9065ebe4872f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start _get_guest_xml network_info=[{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:d3:ca:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '514ac427-1da5-4fb2-9ecc-27393cb575fb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '500f7840-d86c-4620-b93f-9065ebe4872f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'serial': 'a86af50f-7d6b-47e2-b25e-e6b6bc69d03b'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'e8c1e6bc-a19c-47ba-9b5c-4471dc78424e', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<500f7840-d86c-4620-b93f-9065ebe4872f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'numa_topology' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<500f7840-d86c-4620-b93f-9065ebe4872f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'vcpu_model' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<500f7840-d86c-4620-b93f-9065ebe4872f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:55:56 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:56 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:55:56 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b43d9-b736-4167-9e1e-2596ff0f8c53]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LvBsquJk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 00:55:56 user nova-compute[75266]: node.name = iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:55:56 user nova-compute[75266]: node.tpgt = -1
Nov 28 00:55:56 user nova-compute[75266]: node.startup = automatic
Nov 28 00:55:56 user nova-compute[75266]: node.leading_login = No
Nov 28 00:55:56 user nova-compute[75266]: iface.iscsi_ifacename = default
Nov 28 00:55:56 user nova-compute[75266]: iface.net_ifacename = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.ipaddress = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.prefix_len = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.hwaddress = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.transport_name = tcp
Nov 28 00:55:56 user nova-compute[75266]: iface.initiatorname = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.vlan_id = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.vlan_priority = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.vlan_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.iface_num = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.mtu = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.port = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.bootproto = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.subnet_mask = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.gateway = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_alt_client_id = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_dns = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_learn_iqn = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_vendor_id_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_vendor_id = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.dhcp_slp_da = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.fragmentation = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.gratuitous_arp = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.incoming_forwarding = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.tos_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.tos = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.ttl = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.delayed_ack = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.tcp_nagle = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.tcp_wsf_state = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.tcp_wsf = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.tcp_timer_scale = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.tcp_timestamp = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.redirect = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.def_task_mgmt_timeout = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.header_digest = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.data_digest = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.immediate_data = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.initial_r2t = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.data_seq_inorder = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.data_pdu_inorder = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.erl = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.max_receive_data_len = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.first_burst_len = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.max_outstanding_r2t = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.max_burst_len = 0
Nov 28 00:55:56 user nova-compute[75266]: iface.chap_auth = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.bidi_chap = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.strict_login_compliance = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.discovery_auth = <empty>
Nov 28 00:55:56 user nova-compute[75266]: iface.discovery_logout = <empty>
Nov 28 00:55:56 user nova-compute[75266]: node.discovery_address = <empty>
Nov 28 00:55:56 user nova-compute[75266]: node.discovery_port = 0
Nov 28 00:55:56 user nova-compute[75266]: node.discovery_type = static
Nov 28 00:55:56 user nova-compute[75266]: node.session.initial_cmdsn = 0
Nov 28 00:55:56 user nova-compute[75266]: node.session.initial_login_retry_max = 8
Nov 28 00:55:56 user nova-compute[75266]: node.session.xmit_thread_priority = -20
Nov 28 00:55:56 user nova-compute[75266]: node.session.cmds_max = 128
Nov 28 00:55:56 user nova-compute[75266]: node.session.queue_depth = 32
Nov 28 00:55:56 user nova-compute[75266]: node.session.nr_sessions = 1
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.authmethod = CHAP
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.username = LvBsquJk
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.password = ***
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.username_in = <empty>
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.password_in = <empty>
Nov 28 00:55:56 user nova-compute[75266]: node.session.auth.chap_algs = MD5
Nov 28 00:55:56 user nova-compute[75266]: node.session.timeo.replacement_timeout = 120
Nov 28 00:55:56 user nova-compute[75266]: node.session.err_timeo.abort_timeout = 15
Nov 28 00:55:56 user nova-compute[75266]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 00:55:56 user nova-compute[75266]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 00:55:56 user nova-compute[75266]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.FastAbort = Yes
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.InitialR2T = No
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.ImmediateData = Yes
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.MaxConnections = 1
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 00:55:56 user nova-compute[75266]: node.session.iscsi.ERL = 0
Nov 28 00:55:56 user nova-compute[75266]: node.session.scan = manual
Nov 28 00:55:56 user nova-compute[75266]: node.session.reopen_max = 0
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].address = 172.16.0.220
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].port = 3260
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].startup = manual
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].tcp.window_size = 524288
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].tcp.type_of_service = 0
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].timeo.logout_timeout = 15
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].timeo.login_timeout = 15
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].timeo.auth_timeout = 45
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.DataDigest = None
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.IFMarker = No
Nov 28 00:55:56 user nova-compute[75266]: node.conn[0].iscsi.OFMarker = No
Nov 28 00:55:56 user nova-compute[75266]: # END RECORD
Nov 28 00:55:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea68d91-bbf2-462b-97e2-e4ffa506ace6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f441503-1e08-4b8c-92fe-b332d0445ef5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBsquJk {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBsquJk" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1f1af5-f52b-4b7b-8fa5-31f0fd7600c3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvBsquJk'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f748f8a-d53f-47e3-a147-cc7dc4e9f9de]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[535cefc8-94a4-41d8-a441-b2df10c801f7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:55:56 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:55:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HCTL ('39', '0', '0', 0) found on session 37 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c21c4-cb21-4b56-abc2-a31442bc6b82]: (4, ('0 0 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Searching for a device in session 37 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '23634333132363636', 'path': '/dev/sdh'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634333132363636', 'path': '/dev/sdh'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-389395682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-389395682',id=31,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:54:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-iwojbrq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:54:23Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=500f7840-d86c-4620-b93f-9065ebe4872f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:d3:ca:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "vif_mac": "fa:16:3e:d3:ca:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'pci_devices' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.base [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Object Instance<500f7840-d86c-4620-b93f-9065ebe4872f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:55:56 user nova-compute[75266]:   <uuid>500f7840-d86c-4620-b93f-9065ebe4872f</uuid>
Nov 28 00:55:56 user nova-compute[75266]:   <name>instance-0000001f</name>
Nov 28 00:55:56 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:55:56 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:55:56 user nova-compute[75266]:   <metadata>
Nov 28 00:55:56 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:55:56 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-389395682</nova:name>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:55:56</nova:creationTime>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:55:56 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:55:56 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:owner>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:user uuid="8aa0d095400943e28234a9f476ea0a4f">tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member</nova:user>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:project uuid="576886774b2943b999ec92134d8065b4">tempest-ServerBootFromVolumeStableRescueTest-1091313688</nova:project>
Nov 28 00:55:56 user nova-compute[75266]:       </nova:owner>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:55:56 user nova-compute[75266]:       <nova:ports>
Nov 28 00:55:56 user nova-compute[75266]:         <nova:port uuid="4b85a0a3-79a9-4e29-9559-5d25b03f7db5">
Nov 28 00:55:56 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:55:56 user nova-compute[75266]:         </nova:port>
Nov 28 00:55:56 user nova-compute[75266]:       </nova:ports>
Nov 28 00:55:56 user nova-compute[75266]:     </nova:instance>
Nov 28 00:55:56 user nova-compute[75266]:   </metadata>
Nov 28 00:55:56 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:55:56 user nova-compute[75266]:     <system>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="serial">500f7840-d86c-4620-b93f-9065ebe4872f</entry>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="uuid">500f7840-d86c-4620-b93f-9065ebe4872f</entry>
Nov 28 00:55:56 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:55:56 user nova-compute[75266]:     </system>
Nov 28 00:55:56 user nova-compute[75266]:   </sysinfo>
Nov 28 00:55:56 user nova-compute[75266]:   <os>
Nov 28 00:55:56 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:55:56 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:55:56 user nova-compute[75266]:   </os>
Nov 28 00:55:56 user nova-compute[75266]:   <features>
Nov 28 00:55:56 user nova-compute[75266]:     <acpi/>
Nov 28 00:55:56 user nova-compute[75266]:     <apic/>
Nov 28 00:55:56 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:55:56 user nova-compute[75266]:   </features>
Nov 28 00:55:56 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:55:56 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:55:56 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:55:56 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:55:56 user nova-compute[75266]:   </clock>
Nov 28 00:55:56 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:55:56 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:55:56 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:55:56 user nova-compute[75266]:   </cpu>
Nov 28 00:55:56 user nova-compute[75266]:   <devices>
Nov 28 00:55:56 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:55:56 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:55:56 user nova-compute[75266]:       <source dev="/dev/sdh"/>
Nov 28 00:55:56 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:55:56 user nova-compute[75266]:       <serial>a86af50f-7d6b-47e2-b25e-e6b6bc69d03b</serial>
Nov 28 00:55:56 user nova-compute[75266]:     </disk>
Nov 28 00:55:56 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:55:56 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:55:56 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue"/>
Nov 28 00:55:56 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 00:55:56 user nova-compute[75266]:       <boot order="1"/>
Nov 28 00:55:56 user nova-compute[75266]:     </disk>
Nov 28 00:55:56 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:55:56 user nova-compute[75266]:       <mac address="fa:16:3e:d3:ca:9b"/>
Nov 28 00:55:56 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:55:56 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:55:56 user nova-compute[75266]:       <target dev="tap4b85a0a3-79"/>
Nov 28 00:55:56 user nova-compute[75266]:     </interface>
Nov 28 00:55:56 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:55:56 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/console.log" append="off"/>
Nov 28 00:55:56 user nova-compute[75266]:     </serial>
Nov 28 00:55:56 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:55:56 user nova-compute[75266]:     <video>
Nov 28 00:55:56 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:55:56 user nova-compute[75266]:     </video>
Nov 28 00:55:56 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:55:56 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:55:56 user nova-compute[75266]:     </rng>
Nov 28 00:55:56 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:55:56 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:55:56 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:55:56 user nova-compute[75266]:     </memballoon>
Nov 28 00:55:56 user nova-compute[75266]:   </devices>
Nov 28 00:55:56 user nova-compute[75266]: </domain>
Nov 28 00:55:56 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:55:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance destroyed successfully.
Nov 28 00:55:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:55:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:55:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:55:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] No VIF found with MAC fa:16:3e:d3:ca:9b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:55:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:55:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:55:58 user nova-compute[75266]: WARNING nova.compute.manager [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state rescuing.
Nov 28 00:55:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:00 user nova-compute[75266]: WARNING nova.compute.manager [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state rescuing.
Nov 28 00:56:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:56:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:03 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a835216a-04a1-4660-a458-13cca79489c3 is timed out.
Nov 28 00:56:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully detached device vdb from instance a835216a-04a1-4660-a458-13cca79489c3 from the live domain config.
Nov 28 00:56:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKEMngzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:56:03 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8548d38-30de-42f7-9ffa-c3957aaa37b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:56:03 user nova-compute[75266]: No targets found.
Nov 28 00:56:03 user nova-compute[75266]: iSNS:
Nov 28 00:56:03 user nova-compute[75266]: No targets found.
Nov 28 00:56:03 user nova-compute[75266]: STATIC:
Nov 28 00:56:03 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:56:03 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:56:03 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:56:03 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:56:03 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:56:03 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:56:03 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:56:03 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:56:03 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:56:03 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827
Nov 28 00:56:03 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:56:03 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:56:03 user nova-compute[75266]: FIRMWARE:
Nov 28 00:56:03 user nova-compute[75266]: No targets found.
Nov 28 00:56:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:56:03 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:56:03 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca6d516-a8ab-48e7-bffd-439b94f98645]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a386f4-9985-4878-a610-fe5d519ace08]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c3d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f884d32-cc4f-4155-9e47-61aa4cbbb935]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d742fdbd-6d01-4c25-be5e-fb3bbf629ae7]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf7ec8c-6d3d-43cc-a053-83c45f86e89b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077e6ee-31b8-4027-bcf7-dc572b43ebc2]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2caac18-5660-436d-b65f-1b3a721236b2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b234da-f31c-4d64-ab07-9afaf9ee5f36]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260]
Nov 28 00:56:04 user nova-compute[75266]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827, portal: 172.16.0.220,3260] successful.
Nov 28 00:56:04 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685d49b1-0ae7-4bd5-8960-edfa41570827 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[490bb04d-8cf6-4740-929a-047d67695311]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] <== disconnect_volume: return (315ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:56:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:56:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:20 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:56:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:56:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=25.014873504638672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Applying migration context for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 as it has an incoming, in-progress migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e. Migration status is finished {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 00:56:28 user nova-compute[75266]: INFO nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating resource usage from migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a835216a-04a1-4660-a458-13cca79489c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:56:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:56:29 user nova-compute[75266]: INFO nova.compute.manager [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] instance snapshotting
Nov 28 00:56:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Beginning live snapshot process
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381.delta 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381.delta 1073741824" returned: 0 in 0.057s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 00:56:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:56:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:56:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 00:56:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 00:56:32 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:56:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381.delta /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381.delta /opt/stack/data/nova/instances/snapshots/tmp4dzyfb9o/c332b746347d4156bfe0d25a098a9381" returned: 0 in 0.670s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Snapshot extracted, beginning image upload
Nov 28 00:56:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:33 user nova-compute[75266]: INFO nova.compute.manager [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Terminating instance
Nov 28 00:56:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-unplugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Instance destroyed successfully.
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1287657777',display_name='tempest-ServerRescueNegativeTestJSON-server-1287657777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1287657777',id=24,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbgL6uxmLC3MZN+RrqUPtpw5FpUn8maTx0Cf4LCwQCRvDd2+IMQRtiAJBB/3y8VPHozvUpRK0AlMQnI/+Jt36ZBNau3gnhdcxDotPvQEvFguuKb5CmCFRaaKSD+AGTLA==',key_name='tempest-keypair-986818562',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-tlhozz48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad5a4c6583f42b39eda624923ded77b',uuid=a835216a-04a1-4660-a458-13cca79489c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "2df0bea2-3afd-4093-909a-2d0026656990", "address": "fa:16:3e:74:a5:a8", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df0bea2-3a", "ovs_interfaceid": "2df0bea2-3afd-4093-909a-2d0026656990", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG os_vif [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df0bea2-3a, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bce6e4cd-8bc7-41df-b6b4-e85beda57265) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:34 user nova-compute[75266]: INFO os_vif [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:a5:a8,bridge_name='br-int',has_traffic_filtering=True,id=2df0bea2-3afd-4093-909a-2d0026656990,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df0bea2-3a')
Nov 28 00:56:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Deleting instance files /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3_del
Nov 28 00:56:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Deletion of /opt/stack/data/nova/instances/a835216a-04a1-4660-a458-13cca79489c3_del complete
Nov 28 00:56:34 user nova-compute[75266]: INFO nova.compute.manager [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 00:56:34 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:56:34 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-deleted-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:35 user nova-compute[75266]: INFO nova.compute.manager [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Neutron deleted interface 2df0bea2-3afd-4093-909a-2d0026656990; detaching it from the instance and deleting it from the info cache
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:35 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: a835216a-04a1-4660-a458-13cca79489c3] Took 0.68 seconds to deallocate network for instance.
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Detach interface failed, port_id=2df0bea2-3afd-4093-909a-2d0026656990, reason: Instance a835216a-04a1-4660-a458-13cca79489c3 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Snapshot image upload complete
Nov 28 00:56:35 user nova-compute[75266]: INFO nova.compute.manager [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:35 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Deleted allocations for instance a835216a-04a1-4660-a458-13cca79489c3
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "a835216a-04a1-4660-a458-13cca79489c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Acquiring lock "a835216a-04a1-4660-a458-13cca79489c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Lock "a835216a-04a1-4660-a458-13cca79489c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] No waiting events found dispatching network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:35 user nova-compute[75266]: WARNING nova.compute.manager [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] [instance: a835216a-04a1-4660-a458-13cca79489c3] Received unexpected event network-vif-plugged-2df0bea2-3afd-4093-909a-2d0026656990 for instance with vm_state deleted and task_state None.
Nov 28 00:56:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:56:38 user nova-compute[75266]: INFO nova.compute.claims [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Claim successful on node user
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:56:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:56:38 user nova-compute[75266]: DEBUG nova.policy [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:56:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Creating image(s)
Nov 28 00:56:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "/opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "/opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "82b683c346e83b08986361bdba655fb5dfcac0e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "82b683c346e83b08986361bdba655fb5dfcac0e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Successfully created port: 43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.part --force-share --output=json" returned: 0 in 0.230s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG nova.virt.images [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:56:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.part /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.part /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.converted" returned: 0 in 0.551s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Successfully updated port: 43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquired lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing instance network info cache due to event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Acquiring lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "82b683c346e83b08986361bdba655fb5dfcac0e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.479s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "82b683c346e83b08986361bdba655fb5dfcac0e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "82b683c346e83b08986361bdba655fb5dfcac0e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4,backing_fmt=raw /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Releasing lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Instance network_info: |[{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Acquired lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4,backing_fmt=raw /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk 1073741824" returned: 0 in 0.053s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "82b683c346e83b08986361bdba655fb5dfcac0e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Ensure instance console log exists: /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Start _get_guest_xml network_info=[{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4abcd896e59f9dd49536160b927472d4',container_format='bare',created_at=2023-11-28T00:56:30Z,direct_url=<?>,disk_format='qcow2',id=d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-235061251',owner='7a6914d589cc40088c765d5ae8fdd28c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T00:56:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'd15c809e-06d1-4bc6-8fd6-e0a2440ce2ce'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:56:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4abcd896e59f9dd49536160b927472d4',container_format='bare',created_at=2023-11-28T00:56:30Z,direct_url=<?>,disk_format='qcow2',id=d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-235061251',owner='7a6914d589cc40088c765d5ae8fdd28c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T00:56:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-293111776',display_name='tempest-TestStampPattern-server-293111776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293111776',id=32,image_ref='d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-0urxa090',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3702ef7a-256e-4dbe-9b8c-2980c83ddb84',image_min_disk='1',image_min_ram='0',image_owner_id='7a6914d589cc40088c765d5ae8fdd28c',image_owner_project_name='tempest-TestStampPattern-1934253251',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1934253251-project-member',image_user_id='725ae105f36b4b1ca7422d6237a51ff8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:39Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=a2decc79-0682-4b5a-a9e1-84c0738bc32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.objects.instance [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'pci_devices' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:56:42 user nova-compute[75266]:   <uuid>a2decc79-0682-4b5a-a9e1-84c0738bc32f</uuid>
Nov 28 00:56:42 user nova-compute[75266]:   <name>instance-00000020</name>
Nov 28 00:56:42 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:56:42 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:56:42 user nova-compute[75266]:   <metadata>
Nov 28 00:56:42 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:56:42 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:name>tempest-TestStampPattern-server-293111776</nova:name>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:56:42</nova:creationTime>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:56:42 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:56:42 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:owner>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:user uuid="725ae105f36b4b1ca7422d6237a51ff8">tempest-TestStampPattern-1934253251-project-member</nova:user>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:project uuid="7a6914d589cc40088c765d5ae8fdd28c">tempest-TestStampPattern-1934253251</nova:project>
Nov 28 00:56:42 user nova-compute[75266]:       </nova:owner>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:root type="image" uuid="d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce"/>
Nov 28 00:56:42 user nova-compute[75266]:       <nova:ports>
Nov 28 00:56:42 user nova-compute[75266]:         <nova:port uuid="43845fb0-ef5f-465a-81d7-41ae84e3a7eb">
Nov 28 00:56:42 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:56:42 user nova-compute[75266]:         </nova:port>
Nov 28 00:56:42 user nova-compute[75266]:       </nova:ports>
Nov 28 00:56:42 user nova-compute[75266]:     </nova:instance>
Nov 28 00:56:42 user nova-compute[75266]:   </metadata>
Nov 28 00:56:42 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:56:42 user nova-compute[75266]:     <system>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="serial">a2decc79-0682-4b5a-a9e1-84c0738bc32f</entry>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="uuid">a2decc79-0682-4b5a-a9e1-84c0738bc32f</entry>
Nov 28 00:56:42 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:56:42 user nova-compute[75266]:     </system>
Nov 28 00:56:42 user nova-compute[75266]:   </sysinfo>
Nov 28 00:56:42 user nova-compute[75266]:   <os>
Nov 28 00:56:42 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:56:42 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:56:42 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:56:42 user nova-compute[75266]:   </os>
Nov 28 00:56:42 user nova-compute[75266]:   <features>
Nov 28 00:56:42 user nova-compute[75266]:     <acpi/>
Nov 28 00:56:42 user nova-compute[75266]:     <apic/>
Nov 28 00:56:42 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:56:42 user nova-compute[75266]:   </features>
Nov 28 00:56:42 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:56:42 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:56:42 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:56:42 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:56:42 user nova-compute[75266]:   </clock>
Nov 28 00:56:42 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:56:42 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:56:42 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:56:42 user nova-compute[75266]:   </cpu>
Nov 28 00:56:42 user nova-compute[75266]:   <devices>
Nov 28 00:56:42 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:56:42 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:56:42 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk"/>
Nov 28 00:56:42 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:56:42 user nova-compute[75266]:     </disk>
Nov 28 00:56:42 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:56:42 user nova-compute[75266]:       <mac address="fa:16:3e:6a:6b:a0"/>
Nov 28 00:56:42 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:56:42 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:56:42 user nova-compute[75266]:       <target dev="tap43845fb0-ef"/>
Nov 28 00:56:42 user nova-compute[75266]:     </interface>
Nov 28 00:56:42 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:56:42 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/console.log" append="off"/>
Nov 28 00:56:42 user nova-compute[75266]:     </serial>
Nov 28 00:56:42 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:56:42 user nova-compute[75266]:     <video>
Nov 28 00:56:42 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:56:42 user nova-compute[75266]:     </video>
Nov 28 00:56:42 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:56:42 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:56:42 user nova-compute[75266]:     </rng>
Nov 28 00:56:42 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:56:42 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:56:42 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:56:42 user nova-compute[75266]:     </memballoon>
Nov 28 00:56:42 user nova-compute[75266]:   </devices>
Nov 28 00:56:42 user nova-compute[75266]: </domain>
Nov 28 00:56:42 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-293111776',display_name='tempest-TestStampPattern-server-293111776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293111776',id=32,image_ref='d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-0urxa090',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3702ef7a-256e-4dbe-9b8c-2980c83ddb84',image_min_disk='1',image_min_ram='0',image_owner_id='7a6914d589cc40088c765d5ae8fdd28c',image_owner_project_name='tempest-TestStampPattern-1934253251',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1934253251-project-member',image_user_id='725ae105f36b4b1ca7422d6237a51ff8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:39Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=a2decc79-0682-4b5a-a9e1-84c0738bc32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG os_vif [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe99651b-c3d4-58bd-97e3-0ecea3a03b9f', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43845fb0-ef, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43845fb0-ef, col_values=(('qos', UUID('46a4bf6c-754d-4093-be13-a5ad49baf90d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43845fb0-ef, col_values=(('external_ids', {'iface-id': '43845fb0-ef5f-465a-81d7-41ae84e3a7eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:6b:a0', 'vm-uuid': 'a2decc79-0682-4b5a-a9e1-84c0738bc32f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:42 user nova-compute[75266]: INFO os_vif [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef')
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No VIF found with MAC fa:16:3e:6a:6b:a0, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updated VIF entry in instance network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Releasing lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] No waiting events found dispatching network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:44 user nova-compute[75266]: WARNING nova.compute.manager [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received unexpected event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance with vm_state building and task_state spawning.
Nov 28 00:56:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:56:44 user nova-compute[75266]: INFO nova.compute.claims [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Claim successful on node user
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:56:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.policy [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:56:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Creating image(s)
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Going to confirm migration 2 {{(pid=75266) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.209s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk 1073741824" returned: 0 in 0.069s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquired lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'info_cache' on Instance uuid 08844c7b-f7ca-4c50-ac58-eccff6064ec4 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Cannot resize image /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Ensure instance console log exists: /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Successfully created port: 265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] No waiting events found dispatching network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:46 user nova-compute[75266]: WARNING nova.compute.manager [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received unexpected event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance with vm_state building and task_state spawning.
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [{"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Releasing lock "refresh_cache-08844c7b-f7ca-4c50-ac58-eccff6064ec4" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'migration_context' on Instance uuid 08844c7b-f7ca-4c50-ac58-eccff6064ec4 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.objects.base [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Object Instance<08844c7b-f7ca-4c50-ac58-eccff6064ec4> lazy-loaded attributes: info_cache,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:56:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Instance spawned successfully.
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:46 user nova-compute[75266]: INFO nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:46 user nova-compute[75266]: INFO nova.compute.manager [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Took 8.31 seconds to build instance.
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.411s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.497s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Successfully updated port: 265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquired lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:56:46 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Deleted allocation for migration 738e1fd5-d539-4141-aab9-bf77f92c7a7e
Nov 28 00:56:46 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:56:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.968s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Releasing lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Instance network_info: |[{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Start _get_guest_xml network_info=[{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:56:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-960895983',display_name='tempest-AttachVolumeNegativeTest-server-960895983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-960895983',id=33,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeZt2c9UtUtkeVXNTbEsNnGhqm4avOEQ1pdSt7qFI0J5O6ZC6D5QO2RZxaZiPLGAmw7hczfNEUrO1u72wTxnAm0JRO1bulIV8lOW7aQQfrmLSKDWcAsr/0HLEYoQkjksA==',key_name='tempest-keypair-252894268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-ih5vz7q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=f0b22014-115e-4871-8dfa-dd14d4c2312e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'pci_devices' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:56:47 user nova-compute[75266]:   <uuid>f0b22014-115e-4871-8dfa-dd14d4c2312e</uuid>
Nov 28 00:56:47 user nova-compute[75266]:   <name>instance-00000021</name>
Nov 28 00:56:47 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:56:47 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:56:47 user nova-compute[75266]:   <metadata>
Nov 28 00:56:47 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:56:47 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeNegativeTest-server-960895983</nova:name>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:56:47</nova:creationTime>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:56:47 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:56:47 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:owner>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:user uuid="6692115b7e8042c38fb8ecb84a5af250">tempest-AttachVolumeNegativeTest-471615281-project-member</nova:user>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:project uuid="45ead1a8b36544df9a2bf0feb223ba62">tempest-AttachVolumeNegativeTest-471615281</nova:project>
Nov 28 00:56:47 user nova-compute[75266]:       </nova:owner>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:56:47 user nova-compute[75266]:       <nova:ports>
Nov 28 00:56:47 user nova-compute[75266]:         <nova:port uuid="265df925-6615-406d-8c78-0de24d0d6812">
Nov 28 00:56:47 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 00:56:47 user nova-compute[75266]:         </nova:port>
Nov 28 00:56:47 user nova-compute[75266]:       </nova:ports>
Nov 28 00:56:47 user nova-compute[75266]:     </nova:instance>
Nov 28 00:56:47 user nova-compute[75266]:   </metadata>
Nov 28 00:56:47 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:56:47 user nova-compute[75266]:     <system>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="serial">f0b22014-115e-4871-8dfa-dd14d4c2312e</entry>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="uuid">f0b22014-115e-4871-8dfa-dd14d4c2312e</entry>
Nov 28 00:56:47 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:56:47 user nova-compute[75266]:     </system>
Nov 28 00:56:47 user nova-compute[75266]:   </sysinfo>
Nov 28 00:56:47 user nova-compute[75266]:   <os>
Nov 28 00:56:47 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:56:47 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:56:47 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:56:47 user nova-compute[75266]:   </os>
Nov 28 00:56:47 user nova-compute[75266]:   <features>
Nov 28 00:56:47 user nova-compute[75266]:     <acpi/>
Nov 28 00:56:47 user nova-compute[75266]:     <apic/>
Nov 28 00:56:47 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:56:47 user nova-compute[75266]:   </features>
Nov 28 00:56:47 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:56:47 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:56:47 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:56:47 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:56:47 user nova-compute[75266]:   </clock>
Nov 28 00:56:47 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:56:47 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:56:47 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:56:47 user nova-compute[75266]:   </cpu>
Nov 28 00:56:47 user nova-compute[75266]:   <devices>
Nov 28 00:56:47 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:56:47 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:56:47 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk"/>
Nov 28 00:56:47 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:56:47 user nova-compute[75266]:     </disk>
Nov 28 00:56:47 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:56:47 user nova-compute[75266]:       <mac address="fa:16:3e:a7:aa:44"/>
Nov 28 00:56:47 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:56:47 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:56:47 user nova-compute[75266]:       <target dev="tap265df925-66"/>
Nov 28 00:56:47 user nova-compute[75266]:     </interface>
Nov 28 00:56:47 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:56:47 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/console.log" append="off"/>
Nov 28 00:56:47 user nova-compute[75266]:     </serial>
Nov 28 00:56:47 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:56:47 user nova-compute[75266]:     <video>
Nov 28 00:56:47 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:56:47 user nova-compute[75266]:     </video>
Nov 28 00:56:47 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:56:47 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:56:47 user nova-compute[75266]:     </rng>
Nov 28 00:56:47 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:56:47 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:56:47 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:56:47 user nova-compute[75266]:     </memballoon>
Nov 28 00:56:47 user nova-compute[75266]:   </devices>
Nov 28 00:56:47 user nova-compute[75266]: </domain>
Nov 28 00:56:47 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-960895983',display_name='tempest-AttachVolumeNegativeTest-server-960895983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-960895983',id=33,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeZt2c9UtUtkeVXNTbEsNnGhqm4avOEQ1pdSt7qFI0J5O6ZC6D5QO2RZxaZiPLGAmw7hczfNEUrO1u72wTxnAm0JRO1bulIV8lOW7aQQfrmLSKDWcAsr/0HLEYoQkjksA==',key_name='tempest-keypair-252894268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-ih5vz7q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=f0b22014-115e-4871-8dfa-dd14d4c2312e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG os_vif [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fad8427-8f40-581c-a9c7-60fceddca449', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap265df925-66, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap265df925-66, col_values=(('qos', UUID('46372591-d7ae-4668-acdf-6a55e97bef94')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap265df925-66, col_values=(('external_ids', {'iface-id': '265df925-6615-406d-8c78-0de24d0d6812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:aa:44', 'vm-uuid': 'f0b22014-115e-4871-8dfa-dd14d4c2312e'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:47 user nova-compute[75266]: INFO os_vif [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66')
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:56:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:a7:aa:44, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-changed-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Refreshing instance network info cache due to event network-changed-265df925-6615-406d-8c78-0de24d0d6812. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Acquiring lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Acquired lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG nova.network.neutron [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Refreshing network info cache for port 265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG nova.network.neutron [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updated VIF entry in instance network info cache for port 265df925-6615-406d-8c78-0de24d0d6812. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:56:48 user nova-compute[75266]: DEBUG nova.network.neutron [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Releasing lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG nova.compute.manager [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] No waiting events found dispatching network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:49 user nova-compute[75266]: WARNING nova.compute.manager [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received unexpected event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 for instance with vm_state building and task_state spawning.
Nov 28 00:56:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:56:50 user nova-compute[75266]: INFO nova.compute.claims [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Claim successful on node user
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:56:50 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:56:50 user nova-compute[75266]: INFO nova.virt.block_device [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Booting with volume 6a269223-5c71-46b2-a411-719bb3f3c390 at /dev/vda
Nov 28 00:56:50 user nova-compute[75266]: DEBUG nova.policy [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG os_brick.utils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bdd820-d1de-4d5c-880d-f2d47a82088b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c5686-8d2b-4216-afc2-7bcda05b4847]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a6c7b-b1bd-474c-ba2b-d40d5d87f63d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd358b7-8d22-44a9-a84b-e20ea4c6cf52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:56:51 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d75620-a806-4a57-8ee5-847e3b47836d]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.utils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updating existing volume attachment record: a7b0174a-6d48-41c2-a10e-fdd321b08f82 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] No waiting events found dispatching network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:56:51 user nova-compute[75266]: WARNING nova.compute.manager [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received unexpected event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 for instance with vm_state building and task_state spawning.
Nov 28 00:56:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:56:51 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Instance spawned successfully.
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:51 user nova-compute[75266]: INFO nova.compute.manager [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Unshelving
Nov 28 00:56:51 user nova-compute[75266]: INFO nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:56:51 user nova-compute[75266]: INFO nova.virt.block_device [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Booting with volume 5c389382-3b17-46cd-8da9-1a19d1c2ebf6 at /dev/vdc
Nov 28 00:56:51 user nova-compute[75266]: INFO nova.compute.manager [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Took 7.38 seconds to build instance.
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.utils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13392f-08a6-4f31-9032-d8300bf409f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Successfully created port: ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefe6596-9b32-47f1-b7cb-377e2654bc44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[be226ba2-d1b5-4ff8-b704-fc25d67b14a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63c29d-7abd-4220-81be-701c31c7fb4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:56:51 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:56:51 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb19bd-ca12-44c0-867a-0dc757722a64]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG os_brick.utils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:56:51 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating existing volume attachment record: d02b78bc-3602-4faf-9bb3-563331d97092 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Successfully updated port: ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-changed-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Refreshing instance network info cache due to event network-changed-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Acquiring lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updating instance_info_cache with network_info: [{"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Instance network_info: |[{"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Acquired lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:56:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Refreshing network info cache for port ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:56:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updated VIF entry in instance network info cache for port ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:56:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updating instance_info_cache with network_info: [{"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:56:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Releasing lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:56:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:56:59 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Creating image(s)
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Ensure instance console log exists: /opt/stack/data/nova/instances/76ee17b8-1169-4f2d-95ff-74eaf625f96f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Start _get_guest_xml network_info=[{"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmnLlJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76ee17b8-1169-4f2d-95ff-74eaf625f96f', 'attached_at': '', 'detached_at': '', 'volume_id': '6a269223-5c71-46b2-a411-719bb3f3c390', 'serial': '6a269223-5c71-46b2-a411-719bb3f3c390'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a7b0174a-6d48-41c2-a10e-fdd321b08f82', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:56:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmnLlJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:56:59 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:56:59 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:56:59 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cfa60-ac66-40ff-bfac-b8e29c7e65a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:56:59 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eca658-fcee-40e9-85c1-9150e7ff3c9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390] added
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35329a36-b79f-493e-940a-a39d3e4814c3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8057036-ed96-4db5-a5d4-aa2fc693f967]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwmnLlJC {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwmnLlJC" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c16c5-4287-42f5-92ca-e516a74e99f8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwmnLlJC'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdde6863-1028-4111-a6dd-64f5278edd27]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083ac62-fe93-4cb2-8721-d0053c3c1ff6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_requests' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:56:59 user nova-compute[75266]: INFO nova.compute.claims [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Claim successful on node user
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[57740f85-ab98-428e-b9fd-ea859dcf6865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260]
Nov 28 00:56:59 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260] successful.
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d13fa4-e4e5-40f2-a887-ca098e460b8b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8f25e-1bd6-484e-80ff-3f70a951aadb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:56:59 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:56:59 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1048bcf-5cdf-468b-b51d-13fdfd3985f4]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:56:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmnLlJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:00 user nova-compute[75266]: INFO nova.network.neutron [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating port ea295632-a11a-4926-b87a-c3fda4b47a47 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23361656634346366', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361656634346366', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208451470',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtyUkCqD8pOggg2Myig6/PxeFuXzVrScmiQGk1GNq655YfB3ezMyrTbEbh1XsSEcaMceoI1hkpBeejJxOYffgKCKnxu64nQXQgSVZbspfqDypBUIlH0YUYe3s5Z+oWPcw==',key_name='tempest-keypair-1686178802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-7x0jip1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=76ee17b8-1169-4f2d-95ff-74eaf625f96f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid 76ee17b8-1169-4f2d-95ff-74eaf625f96f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:57:00 user nova-compute[75266]:   <uuid>76ee17b8-1169-4f2d-95ff-74eaf625f96f</uuid>
Nov 28 00:57:00 user nova-compute[75266]:   <name>instance-00000022</name>
Nov 28 00:57:00 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:57:00 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:57:00 user nova-compute[75266]:   <metadata>
Nov 28 00:57:00 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:57:00 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:57:00 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1208451470</nova:name>
Nov 28 00:57:00 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:56:59</nova:creationTime>
Nov 28 00:57:00 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:57:00 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:57:00 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:57:00 user nova-compute[75266]:       <nova:owner>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 00:57:00 user nova-compute[75266]:       </nova:owner>
Nov 28 00:57:00 user nova-compute[75266]:       <nova:ports>
Nov 28 00:57:00 user nova-compute[75266]:         <nova:port uuid="ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c">
Nov 28 00:57:00 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 00:57:00 user nova-compute[75266]:         </nova:port>
Nov 28 00:57:00 user nova-compute[75266]:       </nova:ports>
Nov 28 00:57:00 user nova-compute[75266]:     </nova:instance>
Nov 28 00:57:00 user nova-compute[75266]:   </metadata>
Nov 28 00:57:00 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:57:00 user nova-compute[75266]:     <system>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="serial">76ee17b8-1169-4f2d-95ff-74eaf625f96f</entry>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="uuid">76ee17b8-1169-4f2d-95ff-74eaf625f96f</entry>
Nov 28 00:57:00 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:57:00 user nova-compute[75266]:     </system>
Nov 28 00:57:00 user nova-compute[75266]:   </sysinfo>
Nov 28 00:57:00 user nova-compute[75266]:   <os>
Nov 28 00:57:00 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:57:00 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:57:00 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:57:00 user nova-compute[75266]:   </os>
Nov 28 00:57:00 user nova-compute[75266]:   <features>
Nov 28 00:57:00 user nova-compute[75266]:     <acpi/>
Nov 28 00:57:00 user nova-compute[75266]:     <apic/>
Nov 28 00:57:00 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:57:00 user nova-compute[75266]:   </features>
Nov 28 00:57:00 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:57:00 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:57:00 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:57:00 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:57:00 user nova-compute[75266]:   </clock>
Nov 28 00:57:00 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:57:00 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:57:00 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:57:00 user nova-compute[75266]:   </cpu>
Nov 28 00:57:00 user nova-compute[75266]:   <devices>
Nov 28 00:57:00 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:57:00 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:57:00 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 00:57:00 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:57:00 user nova-compute[75266]:       <serial>6a269223-5c71-46b2-a411-719bb3f3c390</serial>
Nov 28 00:57:00 user nova-compute[75266]:     </disk>
Nov 28 00:57:00 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:57:00 user nova-compute[75266]:       <mac address="fa:16:3e:8f:26:ba"/>
Nov 28 00:57:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:57:00 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:57:00 user nova-compute[75266]:       <target dev="taped9c5918-85"/>
Nov 28 00:57:00 user nova-compute[75266]:     </interface>
Nov 28 00:57:00 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:57:00 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/76ee17b8-1169-4f2d-95ff-74eaf625f96f/console.log" append="off"/>
Nov 28 00:57:00 user nova-compute[75266]:     </serial>
Nov 28 00:57:00 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:57:00 user nova-compute[75266]:     <video>
Nov 28 00:57:00 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:57:00 user nova-compute[75266]:     </video>
Nov 28 00:57:00 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:57:00 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:57:00 user nova-compute[75266]:     </rng>
Nov 28 00:57:00 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:57:00 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:57:00 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:57:00 user nova-compute[75266]:     </memballoon>
Nov 28 00:57:00 user nova-compute[75266]:   </devices>
Nov 28 00:57:00 user nova-compute[75266]: </domain>
Nov 28 00:57:00 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208451470',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtyUkCqD8pOggg2Myig6/PxeFuXzVrScmiQGk1GNq655YfB3ezMyrTbEbh1XsSEcaMceoI1hkpBeejJxOYffgKCKnxu64nQXQgSVZbspfqDypBUIlH0YUYe3s5Z+oWPcw==',key_name='tempest-keypair-1686178802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-7x0jip1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=76ee17b8-1169-4f2d-95ff-74eaf625f96f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG os_vif [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f66005b-1486-51f8-9b38-5618e855cf46', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped9c5918-85, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped9c5918-85, col_values=(('qos', UUID('74bb6940-46a3-4e0c-becc-f75b8a285acf')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped9c5918-85, col_values=(('external_ids', {'iface-id': 'ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:26:ba', 'vm-uuid': '76ee17b8-1169-4f2d-95ff-74eaf625f96f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:00 user nova-compute[75266]: INFO os_vif [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85')
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:8f:26:ba, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:57:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing instance network info cache due to event network-changed-ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Acquiring lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.network.neutron [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:57:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Creating image(s)
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Acquired lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Refreshing network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG nova.objects.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<5fcab10a-4f5f-479c-9d0c-907bcea7d87e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "995751a641a9823f519397bbc6e878aa85bc1a77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "995751a641a9823f519397bbc6e878aa85bc1a77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.part --force-share --output=json" returned: 0 in 0.246s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG nova.virt.images [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 5e9be70d-44ff-4bb9-af6f-56c6ac78550a was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.part /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] No waiting events found dispatching network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:02 user nova-compute[75266]: WARNING nova.compute.manager [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received unexpected event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance with vm_state building and task_state spawning.
Nov 28 00:57:03 user nova-compute[75266]: DEBUG nova.network.neutron [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updated VIF entry in instance network info cache for port ea295632-a11a-4926-b87a-c3fda4b47a47. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG nova.network.neutron [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Releasing lock "refresh_cache-5fcab10a-4f5f-479c-9d0c-907bcea7d87e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.part /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.converted" returned: 0 in 0.685s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "995751a641a9823f519397bbc6e878aa85bc1a77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.202s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "995751a641a9823f519397bbc6e878aa85bc1a77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "995751a641a9823f519397bbc6e878aa85bc1a77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77,backing_fmt=raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77,backing_fmt=raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk 1073741824" returned: 0 in 0.050s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "995751a641a9823f519397bbc6e878aa85bc1a77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'migration_context' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG nova.objects.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<5fcab10a-4f5f-479c-9d0c-907bcea7d87e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:57:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Rebasing disk image.
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 -F raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:57:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:57:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Instance spawned successfully.
Nov 28 00:57:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] No waiting events found dispatching network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:05 user nova-compute[75266]: WARNING nova.compute.manager [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received unexpected event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance with vm_state building and task_state spawning.
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:57:05 user nova-compute[75266]: INFO nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 28 00:57:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:57:05 user nova-compute[75266]: INFO nova.compute.manager [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Took 15.23 seconds to build instance.
Nov 28 00:57:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.348s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 -F raw /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk" returned: 0 in 2.588s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Ensure instance console log exists: /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start _get_guest_xml network_info=[{"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7c177e1deb484a6f0e2f606772b25e8a',container_format='bare',created_at=2023-11-28T00:54:58Z,direct_url=<?>,disk_format='qcow2',id=5e9be70d-44ff-4bb9-af6f-56c6ac78550a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2078984112-shelved',owner='52c236f1599d4a4fb181b4aa73058211',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T00:55:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tThfCSHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5fcab10a-4f5f-479c-9d0c-907bcea7d87e', 'attached_at': '', 'detached_at': '', 'volume_id': '5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 'serial': '5c389382-3b17-46cd-8da9-1a19d1c2ebf6'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd02b78bc-3602-4faf-9bb3-563331d97092', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:57:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:57:07 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7c177e1deb484a6f0e2f606772b25e8a',container_format='bare',created_at=2023-11-28T00:54:58Z,direct_url=<?>,disk_format='qcow2',id=5e9be70d-44ff-4bb9-af6f-56c6ac78550a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2078984112-shelved',owner='52c236f1599d4a4fb181b4aa73058211',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T00:55:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.objects.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<5fcab10a-4f5f-479c-9d0c-907bcea7d87e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tThfCSHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:57:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:57:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:57:07 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c454a83-be64-47af-a3e0-a624288bf39f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:57:07 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee483016-0b93-46bc-9fd0-ba8d06666b81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6] added
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d87d53-c0c0-41c9-bb83-d5a2feaef0e4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f468426-2f46-409e-b61c-aa8ecf21f75d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tThfCSHi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tThfCSHi" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df808f95-c810-4531-babd-16cbc2327b82]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tThfCSHi'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ba4c0-d45e-46c8-858c-02390c1c0feb]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4bcde6-9770-4659-ab03-f5003b0396bc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3d9c3e-827c-4514-91b1-fb91643a6269]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260]
Nov 28 00:57:07 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260] successful.
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf18c4c-4b63-432c-8af0-63247485383b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9879c1-9828-4177-9eb8-14106a085d97]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:57:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8906db-653c-4f34-9a93-4ee5f0e69ec3]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:57:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tThfCSHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23431306535653933', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431306535653933', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='5e9be70d-44ff-4bb9-af6f-56c6ac78550a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1702320399',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T00:55:03.427161',shelved_host='user',shelved_image_id='5e9be70d-44ff-4bb9-af6f-56c6ac78550a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.objects.base [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<5fcab10a-4f5f-479c-9d0c-907bcea7d87e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:57:08 user nova-compute[75266]:   <uuid>5fcab10a-4f5f-479c-9d0c-907bcea7d87e</uuid>
Nov 28 00:57:08 user nova-compute[75266]:   <name>instance-0000001c</name>
Nov 28 00:57:08 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:57:08 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:57:08 user nova-compute[75266]:   <metadata>
Nov 28 00:57:08 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:57:08 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2078984112</nova:name>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:57:07</nova:creationTime>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:57:08 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:57:08 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:owner>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:user uuid="1fd50f4f867e4efcad9e16d45dde6df0">tempest-AttachVolumeShelveTestJSON-107867446-project-member</nova:user>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:project uuid="52c236f1599d4a4fb181b4aa73058211">tempest-AttachVolumeShelveTestJSON-107867446</nova:project>
Nov 28 00:57:08 user nova-compute[75266]:       </nova:owner>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:root type="image" uuid="5e9be70d-44ff-4bb9-af6f-56c6ac78550a"/>
Nov 28 00:57:08 user nova-compute[75266]:       <nova:ports>
Nov 28 00:57:08 user nova-compute[75266]:         <nova:port uuid="ea295632-a11a-4926-b87a-c3fda4b47a47">
Nov 28 00:57:08 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 00:57:08 user nova-compute[75266]:         </nova:port>
Nov 28 00:57:08 user nova-compute[75266]:       </nova:ports>
Nov 28 00:57:08 user nova-compute[75266]:     </nova:instance>
Nov 28 00:57:08 user nova-compute[75266]:   </metadata>
Nov 28 00:57:08 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:57:08 user nova-compute[75266]:     <system>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="serial">5fcab10a-4f5f-479c-9d0c-907bcea7d87e</entry>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="uuid">5fcab10a-4f5f-479c-9d0c-907bcea7d87e</entry>
Nov 28 00:57:08 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:57:08 user nova-compute[75266]:     </system>
Nov 28 00:57:08 user nova-compute[75266]:   </sysinfo>
Nov 28 00:57:08 user nova-compute[75266]:   <os>
Nov 28 00:57:08 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:57:08 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:57:08 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:57:08 user nova-compute[75266]:   </os>
Nov 28 00:57:08 user nova-compute[75266]:   <features>
Nov 28 00:57:08 user nova-compute[75266]:     <acpi/>
Nov 28 00:57:08 user nova-compute[75266]:     <apic/>
Nov 28 00:57:08 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:57:08 user nova-compute[75266]:   </features>
Nov 28 00:57:08 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:57:08 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:57:08 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:57:08 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:57:08 user nova-compute[75266]:   </clock>
Nov 28 00:57:08 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:57:08 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:57:08 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:57:08 user nova-compute[75266]:   </cpu>
Nov 28 00:57:08 user nova-compute[75266]:   <devices>
Nov 28 00:57:08 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:57:08 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:57:08 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk"/>
Nov 28 00:57:08 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:57:08 user nova-compute[75266]:     </disk>
Nov 28 00:57:08 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:57:08 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:57:08 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:57:08 user nova-compute[75266]:       <target dev="vdc" bus="virtio"/>
Nov 28 00:57:08 user nova-compute[75266]:       <serial>5c389382-3b17-46cd-8da9-1a19d1c2ebf6</serial>
Nov 28 00:57:08 user nova-compute[75266]:     </disk>
Nov 28 00:57:08 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:57:08 user nova-compute[75266]:       <mac address="fa:16:3e:30:11:20"/>
Nov 28 00:57:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:57:08 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:57:08 user nova-compute[75266]:       <target dev="tapea295632-a1"/>
Nov 28 00:57:08 user nova-compute[75266]:     </interface>
Nov 28 00:57:08 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:57:08 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/console.log" append="off"/>
Nov 28 00:57:08 user nova-compute[75266]:     </serial>
Nov 28 00:57:08 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:57:08 user nova-compute[75266]:     <video>
Nov 28 00:57:08 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:57:08 user nova-compute[75266]:     </video>
Nov 28 00:57:08 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:57:08 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:57:08 user nova-compute[75266]:     </rng>
Nov 28 00:57:08 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:57:08 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:57:08 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:57:08 user nova-compute[75266]:     </memballoon>
Nov 28 00:57:08 user nova-compute[75266]:   </devices>
Nov 28 00:57:08 user nova-compute[75266]: </domain>
Nov 28 00:57:08 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='5e9be70d-44ff-4bb9-af6f-56c6ac78550a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1702320399',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T00:55:03.427161',shelved_host='user',shelved_image_id='5e9be70d-44ff-4bb9-af6f-56c6ac78550a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG os_vif [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2224f41-2ecc-5a2e-bcfd-fcf20e93098e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea295632-a1, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea295632-a1, col_values=(('qos', UUID('9e8ac7b8-91cf-4be4-ad6c-ab651301215d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea295632-a1, col_values=(('external_ids', {'iface-id': 'ea295632-a11a-4926-b87a-c3fda4b47a47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:11:20', 'vm-uuid': '5fcab10a-4f5f-479c-9d0c-907bcea7d87e'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:08 user nova-compute[75266]: INFO os_vif [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1')
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:57:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No VIF found with MAC fa:16:3e:30:11:20, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:10 user nova-compute[75266]: WARNING nova.compute.manager [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:57:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance spawned successfully.
Nov 28 00:57:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:12 user nova-compute[75266]: WARNING nova.compute.manager [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 00:57:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:57:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.471s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:21 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:57:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:57:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:57:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:29 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:57:29 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7308MB free_disk=24.829490661621094GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance bf245d26-e901-4fca-8ff5-a3558974294b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b22014-115e-4871-8dfa-dd14d4c2312e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 00:57:29 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.189s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 00:57:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:32 user nova-compute[75266]: INFO nova.compute.manager [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Terminating instance
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-unplugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Instance destroyed successfully.
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1646530713',display_name='tempest-ServerRescueNegativeTestJSON-server-1646530713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1646530713',id=4,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-k0f7b6ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:28Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=3f32bed1-593f-4bf4-ba26-9496d83fc17f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "address": "fa:16:3e:12:2a:2f", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625efbe6-4f", "ovs_interfaceid": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG os_vif [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap625efbe6-4f, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8abaae7b-4649-4d0d-a070-9a8b836c9594) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:32 user nova-compute[75266]: INFO os_vif [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=625efbe6-4ffa-44c8-90e8-3bb69f390dbb,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625efbe6-4f')
Nov 28 00:57:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Deleting instance files /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f_del
Nov 28 00:57:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Deletion of /opt/stack/data/nova/instances/3f32bed1-593f-4bf4-ba26-9496d83fc17f_del complete
Nov 28 00:57:32 user nova-compute[75266]: INFO nova.compute.manager [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 00:57:32 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:57:32 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Skipping network cache update for instance because it is being deleted. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:57:33 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Took 0.61 seconds to deallocate network for instance.
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-deleted-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [{"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-bf245d26-e901-4fca-8ff5-a3558974294b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:34 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Deleted allocations for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f
Nov 28 00:57:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Acquiring lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Lock "3f32bed1-593f-4bf4-ba26-9496d83fc17f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] No waiting events found dispatching network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:34 user nova-compute[75266]: WARNING nova.compute.manager [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Received unexpected event network-vif-plugged-625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance with vm_state deleted and task_state None.
Nov 28 00:57:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:57:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 00:57:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 00:57:44 user nova-compute[75266]: INFO nova.compute.manager [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Unrescuing
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquired lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating instance_info_cache with network_info: [{"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Releasing lock "refresh_cache-500f7840-d86c-4620-b93f-9065ebe4872f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'flavor' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:44 user nova-compute[75266]: WARNING nova.compute.manager [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:57:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance destroyed successfully.
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:46 user nova-compute[75266]: WARNING nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:57:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:46 user nova-compute[75266]: WARNING nova.compute.manager [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 00:57:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:57:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:57:48 user nova-compute[75266]: WARNING nova.compute.manager [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state None.
Nov 28 00:57:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:57:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 55113bea-793b-4d9f-a897-f6f7eb261079 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 19151248-a33d-46b2-be99-0a85a5ab88d3 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid a5c9b82c-581e-4e29-8d34-286a293a33f9 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 08844c7b-f7ca-4c50-ac58-eccff6064ec4 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 76ee17b8-1169-4f2d-95ff-74eaf625f96f {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.448s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:58:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:58:18 user nova-compute[75266]: INFO nova.compute.claims [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Claim successful on node user
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:58:18 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.policy [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:58:18 user nova-compute[75266]: INFO nova.virt.block_device [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Booting with volume 3fa07cbb-69f4-4464-8f9a-a752bde8d39b at /dev/vda
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.utils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[356f4697-8a95-4346-b769-a238c90784e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb80fd-2aaf-48cc-817c-3d5ee503018d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ce91f-2513-48a4-b393-a6aca7955507]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424b935-14de-4282-8921-7922ad050de1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:18 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:58:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4f295-9a3a-4fd2-bb31-c8d3b0c49b47]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG os_brick.utils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:18 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating existing volume attachment record: f2468bc0-0354-4101-b7f7-cc5d002e4dde {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:58:19 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Successfully created port: 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Successfully updated port: 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing instance network info cache due to event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance network_info: |[{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updated VIF entry in instance network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG nova.network.neutron [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:21 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:22 user nova-compute[75266]: INFO nova.compute.manager [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Terminating instance
Nov 28 00:58:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:58:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Instance destroyed successfully.
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.objects.instance [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'resources' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-368791726',display_name='tempest-ServerRescueNegativeTestJSON-server-368791726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-368791726',id=2,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:46:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e8c7ba7df64471b83fbfb45237c8ee7',ramdisk_id='',reservation_id='r-v0cnts0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1136436756',owner_user_name='tempest-ServerRescueNegativeTestJSON-1136436756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:48:07Z,user_data=None,user_id='aad5a4c6583f42b39eda624923ded77b',uuid=bf245d26-e901-4fca-8ff5-a3558974294b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converting VIF {"id": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "address": "fa:16:3e:f4:e8:58", "network": {"id": "482f09e3-29f6-48fd-8552-3303e851daac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1963061288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e8c7ba7df64471b83fbfb45237c8ee7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d492cfb-25", "ovs_interfaceid": "5d492cfb-25b6-4b28-b279-bd2f648c39f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG os_vif [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d492cfb-25, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=098d0b83-557a-4cbe-b74b-e7603e323308) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:23 user nova-compute[75266]: INFO os_vif [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=5d492cfb-25b6-4b28-b279-bd2f648c39f3,network=Network(482f09e3-29f6-48fd-8552-3303e851daac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d492cfb-25')
Nov 28 00:58:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Deleting instance files /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b_del
Nov 28 00:58:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Deletion of /opt/stack/data/nova/instances/bf245d26-e901-4fca-8ff5-a3558974294b_del complete
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: INFO nova.compute.manager [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 28 00:58:23 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:23 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Took 0.50 seconds to deallocate network for instance.
Nov 28 00:58:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-deleted-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.639s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:24 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Deleted allocations for instance bf245d26-e901-4fca-8ff5-a3558974294b
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "bf245d26-e901-4fca-8ff5-a3558974294b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:24 user nova-compute[75266]: WARNING nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state deleted and task_state None.
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:24 user nova-compute[75266]: WARNING nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state deleted and task_state None.
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:25 user nova-compute[75266]: WARNING nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state deleted and task_state None.
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:25 user nova-compute[75266]: WARNING nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-unplugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state deleted and task_state None.
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "bf245d26-e901-4fca-8ff5-a3558974294b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] No waiting events found dispatching network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:25 user nova-compute[75266]: WARNING nova.compute.manager [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Received unexpected event network-vif-plugged-5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance with vm_state deleted and task_state None.
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:58:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:58:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Creating image(s)
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start _get_guest_xml network_info=[{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e61e82c-a198-4f76-a2b8-84b3c58be36d', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'serial': '3fa07cbb-69f4-4464-8f9a-a752bde8d39b'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f2468bc0-0354-4101-b7f7-cc5d002e4dde', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:58:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:26 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:26 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:26 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:58:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8982a6e1-af6a-4c8d-bb44-ff0acc7334d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:58:26 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f981df70-1692-45fc-b5c8-35961b248e31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b] added
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196986a-5681-474f-8ea0-0a42d23e9a02]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ea2b9-6fb9-46e9-aa39-442ff1d878da]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgwNSTOG {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgwNSTOG" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c06cd6-c2bc-4d56-b0cc-99a44811fb5c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UgwNSTOG'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6917b090-5b30-4b5c-af36-49250a8c937f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5072b1-b203-495a-965d-0cab25eb0d16]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f160d561-7baf-4f45-b933-17b22b115047]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]
Nov 28 00:58:26 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603540d-7b70-4dc1-ac97-f9b34b34f972]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb09cc97-ea57-4f13-b558-a4d0baf50336]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:26 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:26 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67732b7-0b69-44d7-bf65-a194872cd346]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26565313635646538', 'path': '/dev/sdf'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565313635646538', 'path': '/dev/sdf'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KNQqJEkWGmzZifPUVaLA75cWARw0qE/b2TEuxTimAKA+NMfhXs8WJnpbDfmPzdEvNU0XTfO37MxPtD+1IFavGk4iz1iq94AyP1MZC1OnuSEjEHHqIHb9E/bv4urgRBw==',key_name='tempest-TestShelveInstance-2097820211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:19Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.objects.instance [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:58:27 user nova-compute[75266]:   <uuid>1e61e82c-a198-4f76-a2b8-84b3c58be36d</uuid>
Nov 28 00:58:27 user nova-compute[75266]:   <name>instance-00000023</name>
Nov 28 00:58:27 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:58:27 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:58:27 user nova-compute[75266]:   <metadata>
Nov 28 00:58:27 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:58:27 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:58:27 user nova-compute[75266]:       <nova:name>tempest-TestShelveInstance-server-2056787703</nova:name>
Nov 28 00:58:27 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:58:26</nova:creationTime>
Nov 28 00:58:27 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:58:27 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:58:27 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:58:27 user nova-compute[75266]:       <nova:owner>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:user uuid="cbce18d8a1ce4e25a7ba0043f40a3a71">tempest-TestShelveInstance-715884180-project-member</nova:user>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:project uuid="42084ccfd4f3455f976a532e4dbf19f7">tempest-TestShelveInstance-715884180</nova:project>
Nov 28 00:58:27 user nova-compute[75266]:       </nova:owner>
Nov 28 00:58:27 user nova-compute[75266]:       <nova:ports>
Nov 28 00:58:27 user nova-compute[75266]:         <nova:port uuid="64a1cff7-65f8-4910-82eb-3e8332324c63">
Nov 28 00:58:27 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 00:58:27 user nova-compute[75266]:         </nova:port>
Nov 28 00:58:27 user nova-compute[75266]:       </nova:ports>
Nov 28 00:58:27 user nova-compute[75266]:     </nova:instance>
Nov 28 00:58:27 user nova-compute[75266]:   </metadata>
Nov 28 00:58:27 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:58:27 user nova-compute[75266]:     <system>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="serial">1e61e82c-a198-4f76-a2b8-84b3c58be36d</entry>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="uuid">1e61e82c-a198-4f76-a2b8-84b3c58be36d</entry>
Nov 28 00:58:27 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:58:27 user nova-compute[75266]:     </system>
Nov 28 00:58:27 user nova-compute[75266]:   </sysinfo>
Nov 28 00:58:27 user nova-compute[75266]:   <os>
Nov 28 00:58:27 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:58:27 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:58:27 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:58:27 user nova-compute[75266]:   </os>
Nov 28 00:58:27 user nova-compute[75266]:   <features>
Nov 28 00:58:27 user nova-compute[75266]:     <acpi/>
Nov 28 00:58:27 user nova-compute[75266]:     <apic/>
Nov 28 00:58:27 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:58:27 user nova-compute[75266]:   </features>
Nov 28 00:58:27 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:58:27 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:58:27 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:58:27 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:58:27 user nova-compute[75266]:   </clock>
Nov 28 00:58:27 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:58:27 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:58:27 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:58:27 user nova-compute[75266]:   </cpu>
Nov 28 00:58:27 user nova-compute[75266]:   <devices>
Nov 28 00:58:27 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:58:27 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:27 user nova-compute[75266]:       <source dev="/dev/sdf"/>
Nov 28 00:58:27 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:58:27 user nova-compute[75266]:       <serial>3fa07cbb-69f4-4464-8f9a-a752bde8d39b</serial>
Nov 28 00:58:27 user nova-compute[75266]:     </disk>
Nov 28 00:58:27 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:58:27 user nova-compute[75266]:       <mac address="fa:16:3e:ae:4c:9f"/>
Nov 28 00:58:27 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:58:27 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:58:27 user nova-compute[75266]:       <target dev="tap64a1cff7-65"/>
Nov 28 00:58:27 user nova-compute[75266]:     </interface>
Nov 28 00:58:27 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:58:27 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d/console.log" append="off"/>
Nov 28 00:58:27 user nova-compute[75266]:     </serial>
Nov 28 00:58:27 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:58:27 user nova-compute[75266]:     <video>
Nov 28 00:58:27 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:58:27 user nova-compute[75266]:     </video>
Nov 28 00:58:27 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:58:27 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:58:27 user nova-compute[75266]:     </rng>
Nov 28 00:58:27 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:58:27 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:58:27 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:58:27 user nova-compute[75266]:     </memballoon>
Nov 28 00:58:27 user nova-compute[75266]:   </devices>
Nov 28 00:58:27 user nova-compute[75266]: </domain>
Nov 28 00:58:27 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KNQqJEkWGmzZifPUVaLA75cWARw0qE/b2TEuxTimAKA+NMfhXs8WJnpbDfmPzdEvNU0XTfO37MxPtD+1IFavGk4iz1iq94AyP1MZC1OnuSEjEHHqIHb9E/bv4urgRBw==',key_name='tempest-TestShelveInstance-2097820211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:19Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG os_vif [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58e7c722-3e1a-5e6d-831a-918cea80a8fc', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a1cff7-65, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a1cff7-65, col_values=(('qos', UUID('b88b1829-2138-4b70-8674-07a792e23a00')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a1cff7-65, col_values=(('external_ids', {'iface-id': '64a1cff7-65f8-4910-82eb-3e8332324c63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4c:9f', 'vm-uuid': '1e61e82c-a198-4f76-a2b8-84b3c58be36d'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:27 user nova-compute[75266]: INFO os_vif [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65')
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] No VIF found with MAC fa:16:3e:ae:4c:9f, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:31 user nova-compute[75266]: WARNING nova.compute.manager [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state building and task_state spawning.
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=24.88265609741211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance spawned successfully.
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.objects.instance [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:31 user nova-compute[75266]: INFO nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b22014-115e-4871-8dfa-dd14d4c2312e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:58:31 user nova-compute[75266]: INFO nova.compute.manager [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Took 13.94 seconds to build instance.
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.048s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:31 user nova-compute[75266]: INFO nova.compute.manager [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Attaching volume c5864536-2d1a-4694-8028-caab90d64b23 to /dev/vdb
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.utils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47f318-f1f8-4d55-9f47-9edaa64684dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806c106-1c31-4e3d-96f3-cda7faa3cbfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb93ce9e-21bd-4157-8f00-988f27348dbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e16b2-f374-4836-a135-eaa67393af60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:32 user nova-compute[75266]: WARNING nova.compute.manager [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state active and task_state None.
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing instance network info cache due to event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Acquiring lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Acquired lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.network.neutron [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:32 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ff731-2205-4c3f-9509-a38d56f06a24]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG os_brick.utils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating existing volume attachment record: c61594d5-129b-491c-bfc5-dfc866da1bcc {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.network.neutron [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updated VIF entry in instance network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG nova.network.neutron [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Releasing lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:58:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [{"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-55113bea-793b-4d9f-a897-f6f7eb261079" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:58:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-changed-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Refreshing instance network info cache due to event network-changed-265df925-6615-406d-8c78-0de24d0d6812. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Acquiring lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Acquired lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Refreshing network info cache for port 265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updated VIF entry in instance network info cache for port 265df925-6615-406d-8c78-0de24d0d6812. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Releasing lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:36 user nova-compute[75266]: INFO nova.compute.manager [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Get console output
Nov 28 00:58:36 user nova-compute[75266]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 00:58:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:38 user nova-compute[75266]: INFO nova.compute.manager [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Attaching volume 89fef214-9301-4d77-bb3e-cdfa422e83de to /dev/vdb
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.utils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79e6800-f60e-44e1-8bf7-9d68b4cb8a7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d343e93-a87d-44a3-a283-5a51424bcc18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb45480-a154-4f10-8f5b-e4577565444d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165b786-d965-416c-8dd0-9720ab2e34d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:38 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:58:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ab19ac-be2b-4d52-bc07-5604266826d0]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG os_brick.utils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:38 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating existing volume attachment record: b7f7ca24-6618-4b17-b89f-a2cd3d753ead {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZujdiHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:39 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ef5b86-62f5-4dbd-b2f1-97d8800e4d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:58:39 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[906c803b-82d0-4a21-9027-28626727ef06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23] added
Nov 28 00:58:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41dedb-aca2-4c3d-8913-9b6f21d8c224]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dbd854-2f29-4a2f-8522-23ad6feb7653]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZujdiHk {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZujdiHk" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54bc9a7-14fe-40c5-b9e0-3ed84cff159f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZujdiHk'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd81b47-fbf6-41ee-9825-53f7b398445a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b201c01-a931-48dc-94a7-46ed7eba47c8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:39 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --login" returned: 0 in 0.132s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f480d-1999-4db8-8700-592b3b36bc51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260]
Nov 28 00:58:39 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260] successful.
Nov 28 00:58:39 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f58b0b3-9c08-4a59-a666-778630981a7d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2942b1f-ccbc-412e-b120-159adba73de9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:40 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.073s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee364b62-f207-40c1-9ef5-68261ac1c72c]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZujdiHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-changed-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Refreshing instance network info cache due to event network-changed-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Acquiring lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Acquired lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Refreshing network info cache for port ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== connect_volume: return (1562ms) {'type': 'block', 'scsi_wwn': '23831656235353834', 'path': '/dev/sdg'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831656235353834', 'path': '/dev/sdg'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.objects.instance [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:58:41 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:41 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:58:41 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:58:41 user nova-compute[75266]:   <serial>c5864536-2d1a-4694-8028-caab90d64b23</serial>
Nov 28 00:58:41 user nova-compute[75266]: </disk>
Nov 28 00:58:41 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updated VIF entry in instance network info cache for port ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updating instance_info_cache with network_info: [{"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Releasing lock "refresh_cache-76ee17b8-1169-4f2d-95ff-74eaf625f96f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] No VIF found with MAC fa:16:3e:6a:6b:a0, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.798s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:41 user nova-compute[75266]: INFO nova.compute.manager [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Detaching volume 5c389382-3b17-46cd-8da9-1a19d1c2ebf6
Nov 28 00:58:42 user nova-compute[75266]: INFO nova.virt.block_device [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Attempting to driver detach volume 5c389382-3b17-46cd-8da9-1a19d1c2ebf6 from mountpoint /dev/vdc
Nov 28 00:58:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Attempting to detach device vdc from instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:58:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:58:42 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:42 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:58:42 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 00:58:42 user nova-compute[75266]:   <serial>5c389382-3b17-46cd-8da9-1a19d1c2ebf6</serial>
Nov 28 00:58:42 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:58:42 user nova-compute[75266]: </disk>
Nov 28 00:58:42 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:58:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully detached device vdc from instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e from the persistent domain config.
Nov 28 00:58:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:58:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:58:42 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:42 user nova-compute[75266]:   <source dev="/dev/sdd"/>
Nov 28 00:58:42 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 00:58:42 user nova-compute[75266]:   <serial>5c389382-3b17-46cd-8da9-1a19d1c2ebf6</serial>
Nov 28 00:58:42 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 00:58:42 user nova-compute[75266]: </disk>
Nov 28 00:58:42 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:58:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:58:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:44 user nova-compute[75266]: INFO nova.compute.manager [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Detaching volume c5864536-2d1a-4694-8028-caab90d64b23
Nov 28 00:58:44 user nova-compute[75266]: INFO nova.virt.block_device [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Attempting to driver detach volume c5864536-2d1a-4694-8028-caab90d64b23 from mountpoint /dev/vdb
Nov 28 00:58:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Attempting to detach device vdb from instance a2decc79-0682-4b5a-a9e1-84c0738bc32f from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 00:58:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:58:44 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:44 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:58:44 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:58:44 user nova-compute[75266]:   <serial>c5864536-2d1a-4694-8028-caab90d64b23</serial>
Nov 28 00:58:44 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:58:44 user nova-compute[75266]: </disk>
Nov 28 00:58:44 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:58:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully detached device vdb from instance a2decc79-0682-4b5a-a9e1-84c0738bc32f from the persistent domain config.
Nov 28 00:58:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2decc79-0682-4b5a-a9e1-84c0738bc32f from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 00:58:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 00:58:44 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:44 user nova-compute[75266]:   <source dev="/dev/sdg"/>
Nov 28 00:58:44 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:58:44 user nova-compute[75266]:   <serial>c5864536-2d1a-4694-8028-caab90d64b23</serial>
Nov 28 00:58:44 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 00:58:44 user nova-compute[75266]: </disk>
Nov 28 00:58:44 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 00:58:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 00:58:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqotmCFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:46 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:46 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:58:46 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128fb51-b924-4d7c-8c01-587e0acbdb00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:58:46 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ad50f-654d-4a54-aac5-99c8f27bbf9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de] added
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb5472f-1f18-40d1-9863-99ad031bb6bb]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1898c3fd-32c1-46bc-9b0e-e8f805afd700]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqotmCFE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqotmCFE" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a6a9b7-ada0-450e-b0fa-650f243b0cff]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqotmCFE'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de0a3d2-1f7c-4fcc-9a45-8eed480b5aea]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb326e-2699-4ca4-b821-d294422e7b9b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8060711f-992d-48b7-acb4-d673c10db9ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260]
Nov 28 00:58:46 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260] successful.
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e9dea-b77f-4d09-9566-3ca1d4735e14]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[778515e7-7e44-43c7-81f7-ce67f536c01c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:58:46 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:58:46 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HCTL ('40', '-', '-', 0) found on session 45 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c913c-68cc-41fd-89fb-11888a6d5302]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching for a device in session 45 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:58:46 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqotmCFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26534376462383663', 'path': '/dev/sdi'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534376462383663', 'path': '/dev/sdi'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 00:58:47 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:58:47 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 00:58:47 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 00:58:47 user nova-compute[75266]:   <serial>89fef214-9301-4d77-bb3e-cdfa422e83de</serial>
Nov 28 00:58:47 user nova-compute[75266]: </disk>
Nov 28 00:58:47 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 00:58:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:a7:aa:44, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:58:48 user nova-compute[75266]: INFO nova.compute.claims [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Claim successful on node user
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.216s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:58:48 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:58:48 user nova-compute[75266]: DEBUG nova.policy [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:58:48 user nova-compute[75266]: INFO nova.virt.block_device [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Booting with volume snapshot 6d135966-e923-43cd-91eb-a9024285fe1e at /dev/vda
Nov 28 00:58:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Successfully created port: f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Successfully updated port: f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-changed-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Refreshing instance network info cache due to event network-changed-f19fff11-b050-4a94-9fad-1bdb14c14f72. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Acquiring lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating instance_info_cache with network_info: [{"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Instance network_info: |[{"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Acquired lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:50 user nova-compute[75266]: DEBUG nova.network.neutron [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Refreshing network info cache for port f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updated VIF entry in instance network info cache for port f19fff11-b050-4a94-9fad-1bdb14c14f72. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:51 user nova-compute[75266]: DEBUG nova.network.neutron [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating instance_info_cache with network_info: [{"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Releasing lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:58:52 user nova-compute[75266]: INFO nova.compute.claims [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Claim successful on node user
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:58:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:58:52 user nova-compute[75266]: DEBUG nova.policy [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:58:53 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Creating image(s)
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk 1073741824" returned: 0 in 0.055s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Successfully created port: 403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Cannot resize image /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Ensure instance console log exists: /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Successfully updated port: 403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquired lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-changed-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Refreshing instance network info cache due to event network-changed-403dbea6-2bda-4b17-9d20-e17ae32d6e73. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Acquiring lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.utils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42197bc-f78b-497b-b806-cc661c19b06d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updating instance_info_cache with network_info: [{"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5583db1c-e306-4e62-8d10-3144d8629a4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Releasing lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Instance network_info: |[{"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Acquired lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.neutron [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Refreshing network info cache for port 403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Start _get_guest_xml network_info=[{"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1aaffe-b2f4-4fdd-af6e-768fadacee67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef7cbe-de9c-4ddc-a1eb-41838c633cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:58:54 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:54 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625351436',display_name='tempest-AttachVolumeNegativeTest-server-625351436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625351436',id=37,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSpAopraW6cNHBCbcsQ7cRNBLTfzxnb3VVz6xYSxROk9zSsm8WrrtUdXPXyVFQd/08QBbchhzBNuPIdsQS1cS6wTd+5XTV6jLa4pMhL3tQfjQwEyy4G4ybftgCqIf3aw==',key_name='tempest-keypair-509848427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-awe04lve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'pci_devices' on Instance uuid ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 00:58:54 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 00:58:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[77790cc3-c84d-479f-8412-c6968415b11f]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_brick.utils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating existing volume attachment record: 288e9f31-6014-406c-a387-c4c298567d06 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:58:54 user nova-compute[75266]:   <uuid>ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c</uuid>
Nov 28 00:58:54 user nova-compute[75266]:   <name>instance-00000025</name>
Nov 28 00:58:54 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:58:54 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:58:54 user nova-compute[75266]:   <metadata>
Nov 28 00:58:54 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:58:54 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeNegativeTest-server-625351436</nova:name>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:58:54</nova:creationTime>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:58:54 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:58:54 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:owner>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:user uuid="6692115b7e8042c38fb8ecb84a5af250">tempest-AttachVolumeNegativeTest-471615281-project-member</nova:user>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:project uuid="45ead1a8b36544df9a2bf0feb223ba62">tempest-AttachVolumeNegativeTest-471615281</nova:project>
Nov 28 00:58:54 user nova-compute[75266]:       </nova:owner>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:58:54 user nova-compute[75266]:       <nova:ports>
Nov 28 00:58:54 user nova-compute[75266]:         <nova:port uuid="403dbea6-2bda-4b17-9d20-e17ae32d6e73">
Nov 28 00:58:54 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 00:58:54 user nova-compute[75266]:         </nova:port>
Nov 28 00:58:54 user nova-compute[75266]:       </nova:ports>
Nov 28 00:58:54 user nova-compute[75266]:     </nova:instance>
Nov 28 00:58:54 user nova-compute[75266]:   </metadata>
Nov 28 00:58:54 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:58:54 user nova-compute[75266]:     <system>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="serial">ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c</entry>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="uuid">ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c</entry>
Nov 28 00:58:54 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:58:54 user nova-compute[75266]:     </system>
Nov 28 00:58:54 user nova-compute[75266]:   </sysinfo>
Nov 28 00:58:54 user nova-compute[75266]:   <os>
Nov 28 00:58:54 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:58:54 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:58:54 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:58:54 user nova-compute[75266]:   </os>
Nov 28 00:58:54 user nova-compute[75266]:   <features>
Nov 28 00:58:54 user nova-compute[75266]:     <acpi/>
Nov 28 00:58:54 user nova-compute[75266]:     <apic/>
Nov 28 00:58:54 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:58:54 user nova-compute[75266]:   </features>
Nov 28 00:58:54 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:58:54 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:58:54 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:58:54 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:58:54 user nova-compute[75266]:   </clock>
Nov 28 00:58:54 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:58:54 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:58:54 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:58:54 user nova-compute[75266]:   </cpu>
Nov 28 00:58:54 user nova-compute[75266]:   <devices>
Nov 28 00:58:54 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:58:54 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:58:54 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk"/>
Nov 28 00:58:54 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:58:54 user nova-compute[75266]:     </disk>
Nov 28 00:58:54 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:58:54 user nova-compute[75266]:       <mac address="fa:16:3e:56:34:b2"/>
Nov 28 00:58:54 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:58:54 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:58:54 user nova-compute[75266]:       <target dev="tap403dbea6-2b"/>
Nov 28 00:58:54 user nova-compute[75266]:     </interface>
Nov 28 00:58:54 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:58:54 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/console.log" append="off"/>
Nov 28 00:58:54 user nova-compute[75266]:     </serial>
Nov 28 00:58:54 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:58:54 user nova-compute[75266]:     <video>
Nov 28 00:58:54 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:58:54 user nova-compute[75266]:     </video>
Nov 28 00:58:54 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:58:54 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:58:54 user nova-compute[75266]:     </rng>
Nov 28 00:58:54 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:58:54 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:58:54 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:58:54 user nova-compute[75266]:     </memballoon>
Nov 28 00:58:54 user nova-compute[75266]:   </devices>
Nov 28 00:58:54 user nova-compute[75266]: </domain>
Nov 28 00:58:54 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625351436',display_name='tempest-AttachVolumeNegativeTest-server-625351436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625351436',id=37,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSpAopraW6cNHBCbcsQ7cRNBLTfzxnb3VVz6xYSxROk9zSsm8WrrtUdXPXyVFQd/08QBbchhzBNuPIdsQS1cS6wTd+5XTV6jLa4pMhL3tQfjQwEyy4G4ybftgCqIf3aw==',key_name='tempest-keypair-509848427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-awe04lve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG os_vif [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9493d19f-6530-5478-9b4b-b7b200191cf7', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap403dbea6-2b, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap403dbea6-2b, col_values=(('qos', UUID('f132e50b-d1d4-412c-9153-83d982de55d4')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap403dbea6-2b, col_values=(('external_ids', {'iface-id': '403dbea6-2bda-4b17-9d20-e17ae32d6e73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:34:b2', 'vm-uuid': 'ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:58:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:54 user nova-compute[75266]: INFO os_vif [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b')
Nov 28 00:58:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:58:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:56:34:b2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:58:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updated VIF entry in instance network info cache for port 403dbea6-2bda-4b17-9d20-e17ae32d6e73. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:58:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updating instance_info_cache with network_info: [{"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:58:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Releasing lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:56 user nova-compute[75266]: DEBUG nova.compute.manager [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] No waiting events found dispatching network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:56 user nova-compute[75266]: WARNING nova.compute.manager [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received unexpected event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance with vm_state building and task_state spawning.
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:58:58 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Instance spawned successfully.
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:58:58 user nova-compute[75266]: INFO nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:58:58 user nova-compute[75266]: INFO nova.compute.manager [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Took 6.45 seconds to build instance.
Nov 28 00:58:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.696s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:58:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] No waiting events found dispatching network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:58:58 user nova-compute[75266]: WARNING nova.compute.manager [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received unexpected event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance with vm_state active and task_state None.
Nov 28 00:58:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:02 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e is timed out.
Nov 28 00:59:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully detached device vdc from instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e from the live domain config.
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tThfCSHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:59:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbcdf54-09a1-47bc-bd17-673fb30ffb5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:59:02 user nova-compute[75266]: No targets found.
Nov 28 00:59:02 user nova-compute[75266]: iSNS:
Nov 28 00:59:02 user nova-compute[75266]: No targets found.
Nov 28 00:59:02 user nova-compute[75266]: STATIC:
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 00:59:02 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:02 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:02 user nova-compute[75266]: FIRMWARE:
Nov 28 00:59:02 user nova-compute[75266]: No targets found.
Nov 28 00:59:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:59:02 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:59:02 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:59:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Creating image(s)
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Ensure instance console log exists: /opt/stack/data/nova/instances/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Start _get_guest_xml network_info=[{"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T00:58:42Z,direct_url=<?>,disk_format='qcow2',id=c147252c-f6ee-4636-bb61-7d559394663a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2145695423',owner='5fd11e875f8544b495ef779a772b8a27',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T00:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAyaQLxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20', 'attached_at': '', 'detached_at': '', 'volume_id': '59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 'serial': '59405c9b-8d98-4dd5-b9a7-8c346cfc205b'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '288e9f31-6014-406c-a387-c4c298567d06', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e915b25-ffee-4b86-98c3-b564a6b16ffb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:02 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T00:58:42Z,direct_url=<?>,disk_format='qcow2',id=c147252c-f6ee-4636-bb61-7d559394663a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2145695423',owner='5fd11e875f8544b495ef779a772b8a27',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T00:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAyaQLxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:59:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e80232-0dbd-490e-b74e-a37310a5f22d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:02 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bb6788160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2def2-c51c-4571-be4a-6751c689a312]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efed690-abc3-4995-a5fb-ffab626148f0]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e63032-5cbb-4a4f-b2cd-31b20afc62eb]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c513a-7f9c-45e9-8e8b-5a764eea2f3b]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e5d7c-d244-406b-ae0c-bdb6da8890f7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe00108-0229-44fd-9a03-5155c9181533]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260]
Nov 28 00:59:02 user nova-compute[75266]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6, portal: 172.16.0.220,3260] successful.
Nov 28 00:59:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c389382-3b17-46cd-8da9-1a19d1c2ebf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038ff8c-bed4-4ecf-93c6-5b9d1498730e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] <== disconnect_volume: return (382ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.277s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:02 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2217d9a2-959c-43b5-8ba8-8e8a5f34b715]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 00:59:02 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98e1537-5275-4b85-9a15-a8e345403bfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b] added
Nov 28 00:59:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a56cd64-46cb-4d46-9535-06326836a2b2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9b6a28-8711-464a-97a6-b995f8ec7da5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wAyaQLxd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wAyaQLxd" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b5dd7-7a16-4318-86c8-1c053e1e0b0e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wAyaQLxd'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545f4c3-0cd4-487d-a209-2144db160df0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe67d2a-c28a-41c5-b2d6-3e936ad64d9f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b69e2a3-2047-4ff4-8b7e-7316db16c5e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260]
Nov 28 00:59:03 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260] successful.
Nov 28 00:59:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4906ba59-d921-425a-ba1a-f522ee6dfc9f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f370301-7c4e-4ef5-97b5-91bf6d45cd5f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:03 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:03 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.100s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[75541236-9b24-4215-8042-52837bcb738e]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAyaQLxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'flavor' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1737ms) {'type': 'block', 'scsi_wwn': '26561356262343066', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561356262343066', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947899743',id=36,image_ref='c147252c-f6ee-4636-bb61-7d559394663a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy1apJVpf98tjT3O9I7ncn5SN4dSBHY9Yj0vxMq6JMtxNahVKM1GH5RAuf8kRxS9rGJGRcunlLXZQQV0rfE2RW5xi41ldPgN0diD7Q+JsGAeuRkXhRJQUBTPVe25N4gcQ==',key_name='tempest-keypair-755313768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-let50sqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156826038',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:59:04 user nova-compute[75266]:   <uuid>60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20</uuid>
Nov 28 00:59:04 user nova-compute[75266]:   <name>instance-00000024</name>
Nov 28 00:59:04 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:59:04 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:59:04 user nova-compute[75266]:   <metadata>
Nov 28 00:59:04 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:59:04 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1947899743</nova:name>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:59:02</nova:creationTime>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:59:04 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:59:04 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:owner>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 00:59:04 user nova-compute[75266]:       </nova:owner>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:root type="image" uuid="c147252c-f6ee-4636-bb61-7d559394663a"/>
Nov 28 00:59:04 user nova-compute[75266]:       <nova:ports>
Nov 28 00:59:04 user nova-compute[75266]:         <nova:port uuid="f19fff11-b050-4a94-9fad-1bdb14c14f72">
Nov 28 00:59:04 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 00:59:04 user nova-compute[75266]:         </nova:port>
Nov 28 00:59:04 user nova-compute[75266]:       </nova:ports>
Nov 28 00:59:04 user nova-compute[75266]:     </nova:instance>
Nov 28 00:59:04 user nova-compute[75266]:   </metadata>
Nov 28 00:59:04 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:59:04 user nova-compute[75266]:     <system>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="serial">60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20</entry>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="uuid">60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20</entry>
Nov 28 00:59:04 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:59:04 user nova-compute[75266]:     </system>
Nov 28 00:59:04 user nova-compute[75266]:   </sysinfo>
Nov 28 00:59:04 user nova-compute[75266]:   <os>
Nov 28 00:59:04 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:59:04 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:59:04 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:59:04 user nova-compute[75266]:   </os>
Nov 28 00:59:04 user nova-compute[75266]:   <features>
Nov 28 00:59:04 user nova-compute[75266]:     <acpi/>
Nov 28 00:59:04 user nova-compute[75266]:     <apic/>
Nov 28 00:59:04 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:59:04 user nova-compute[75266]:   </features>
Nov 28 00:59:04 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:59:04 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:59:04 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:59:04 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:59:04 user nova-compute[75266]:   </clock>
Nov 28 00:59:04 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:59:04 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:59:04 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:59:04 user nova-compute[75266]:   </cpu>
Nov 28 00:59:04 user nova-compute[75266]:   <devices>
Nov 28 00:59:04 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 00:59:04 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 00:59:04 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 00:59:04 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:59:04 user nova-compute[75266]:       <serial>59405c9b-8d98-4dd5-b9a7-8c346cfc205b</serial>
Nov 28 00:59:04 user nova-compute[75266]:     </disk>
Nov 28 00:59:04 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:59:04 user nova-compute[75266]:       <mac address="fa:16:3e:63:58:4b"/>
Nov 28 00:59:04 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:59:04 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:59:04 user nova-compute[75266]:       <target dev="tapf19fff11-b0"/>
Nov 28 00:59:04 user nova-compute[75266]:     </interface>
Nov 28 00:59:04 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:59:04 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20/console.log" append="off"/>
Nov 28 00:59:04 user nova-compute[75266]:     </serial>
Nov 28 00:59:04 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:59:04 user nova-compute[75266]:     <video>
Nov 28 00:59:04 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:59:04 user nova-compute[75266]:     </video>
Nov 28 00:59:04 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:59:04 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:59:04 user nova-compute[75266]:     </rng>
Nov 28 00:59:04 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:59:04 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:59:04 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:59:04 user nova-compute[75266]:     </memballoon>
Nov 28 00:59:04 user nova-compute[75266]:   </devices>
Nov 28 00:59:04 user nova-compute[75266]: </domain>
Nov 28 00:59:04 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947899743',id=36,image_ref='c147252c-f6ee-4636-bb61-7d559394663a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy1apJVpf98tjT3O9I7ncn5SN4dSBHY9Yj0vxMq6JMtxNahVKM1GH5RAuf8kRxS9rGJGRcunlLXZQQV0rfE2RW5xi41ldPgN0diD7Q+JsGAeuRkXhRJQUBTPVe25N4gcQ==',key_name='tempest-keypair-755313768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-let50sqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156826038',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_vif [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c402734d-4ac7-5ad4-a492-8f912b9f633a', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf19fff11-b0, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf19fff11-b0, col_values=(('qos', UUID('e15e2dae-3c80-45b6-be84-b3dfb8a6decf')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf19fff11-b0, col_values=(('external_ids', {'iface-id': 'f19fff11-b050-4a94-9fad-1bdb14c14f72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:58:4b', 'vm-uuid': '60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:04 user nova-compute[75266]: INFO os_vif [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0')
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:63:58:4b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:59:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2decc79-0682-4b5a-a9e1-84c0738bc32f is timed out.
Nov 28 00:59:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully detached device vdb from instance a2decc79-0682-4b5a-a9e1-84c0738bc32f from the live domain config.
Nov 28 00:59:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZujdiHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:59:04 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e35016-d29f-4496-855d-a0df9f57d1a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:59:04 user nova-compute[75266]: No targets found.
Nov 28 00:59:04 user nova-compute[75266]: iSNS:
Nov 28 00:59:04 user nova-compute[75266]: No targets found.
Nov 28 00:59:04 user nova-compute[75266]: STATIC:
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 00:59:04 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:04 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:04 user nova-compute[75266]: FIRMWARE:
Nov 28 00:59:04 user nova-compute[75266]: No targets found.
Nov 28 00:59:04 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:59:04 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:59:04 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2faf5-9e27-403f-9ac9-457d33e585fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd63815-52b1-411e-b08e-053388bbd50b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:04 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:04 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c438280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23'): ({'sdg'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Removing single pathed devices sdg {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dde0660-297a-4910-aeca-b983489461a5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e1cd7-7e8b-4ef6-b00a-dcdc6a374454]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flushing IO for device /dev/sdg {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a04422-fafc-4c7f-9e04-f1d9d70d5daf]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0427fc2e-3fb4-4278-82d2-53122bc951cf]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] SCSI volumes sdg have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:59:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da2583e-bf5f-435d-b2e6-d01359256547]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce0be5-a6b9-4ac6-a277-f7bb990b0f19]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260]
Nov 28 00:59:05 user nova-compute[75266]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23, portal: 172.16.0.220,3260] successful.
Nov 28 00:59:05 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5864536-2d1a-4694-8028-caab90d64b23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[070bb27a-23f5-4a6e-885c-e82c8b7f54a5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] <== disconnect_volume: return (344ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG nova.objects.instance [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'flavor' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] No waiting events found dispatching network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:05 user nova-compute[75266]: WARNING nova.compute.manager [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received unexpected event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance with vm_state building and task_state spawning.
Nov 28 00:59:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:59:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Instance spawned successfully.
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:07 user nova-compute[75266]: INFO nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 28 00:59:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:59:07 user nova-compute[75266]: INFO nova.compute.manager [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Took 19.78 seconds to build instance.
Nov 28 00:59:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.917s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] No waiting events found dispatching network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:08 user nova-compute[75266]: WARNING nova.compute.manager [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received unexpected event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance with vm_state active and task_state None.
Nov 28 00:59:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 00:59:24 user nova-compute[75266]: INFO nova.compute.claims [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Claim successful on node user
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 00:59:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 00:59:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.policy [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 00:59:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Creating image(s)
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "/opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "/opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "/opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk 1073741824" returned: 0 in 0.050s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Successfully created port: cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Cannot resize image /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Ensure instance console log exists: /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Successfully updated port: cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquired lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-changed-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Refreshing instance network info cache due to event network-changed-cbe5cb94-844b-4115-a79a-e58beb743d42. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Acquiring lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updating instance_info_cache with network_info: [{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Releasing lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Instance network_info: |[{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Acquired lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.neutron [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Refreshing network info cache for port cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Start _get_guest_xml network_info=[{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 00:59:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401399961',display_name='tempest-ServersNegativeTestJSON-server-1401399961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401399961',id=38,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-g5cch82i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:59:25Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=b375c38b-e368-4e2a-b988-0ae27130a878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lazy-loading 'pci_devices' on Instance uuid b375c38b-e368-4e2a-b988-0ae27130a878 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] End _get_guest_xml xml=<domain type="kvm">
Nov 28 00:59:26 user nova-compute[75266]:   <uuid>b375c38b-e368-4e2a-b988-0ae27130a878</uuid>
Nov 28 00:59:26 user nova-compute[75266]:   <name>instance-00000026</name>
Nov 28 00:59:26 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 00:59:26 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 00:59:26 user nova-compute[75266]:   <metadata>
Nov 28 00:59:26 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 00:59:26 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:name>tempest-ServersNegativeTestJSON-server-1401399961</nova:name>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:creationTime>2023-11-28 00:59:26</nova:creationTime>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 00:59:26 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 00:59:26 user nova-compute[75266]:       </nova:flavor>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:owner>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:user uuid="8679237c178f427a9cc7887c21fe12cf">tempest-ServersNegativeTestJSON-647957928-project-member</nova:user>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:project uuid="eaf19f7d462f4fa2a9204479d1d35811">tempest-ServersNegativeTestJSON-647957928</nova:project>
Nov 28 00:59:26 user nova-compute[75266]:       </nova:owner>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 00:59:26 user nova-compute[75266]:       <nova:ports>
Nov 28 00:59:26 user nova-compute[75266]:         <nova:port uuid="cbe5cb94-844b-4115-a79a-e58beb743d42">
Nov 28 00:59:26 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 00:59:26 user nova-compute[75266]:         </nova:port>
Nov 28 00:59:26 user nova-compute[75266]:       </nova:ports>
Nov 28 00:59:26 user nova-compute[75266]:     </nova:instance>
Nov 28 00:59:26 user nova-compute[75266]:   </metadata>
Nov 28 00:59:26 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 00:59:26 user nova-compute[75266]:     <system>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="serial">b375c38b-e368-4e2a-b988-0ae27130a878</entry>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="uuid">b375c38b-e368-4e2a-b988-0ae27130a878</entry>
Nov 28 00:59:26 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 00:59:26 user nova-compute[75266]:     </system>
Nov 28 00:59:26 user nova-compute[75266]:   </sysinfo>
Nov 28 00:59:26 user nova-compute[75266]:   <os>
Nov 28 00:59:26 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 00:59:26 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 00:59:26 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 00:59:26 user nova-compute[75266]:   </os>
Nov 28 00:59:26 user nova-compute[75266]:   <features>
Nov 28 00:59:26 user nova-compute[75266]:     <acpi/>
Nov 28 00:59:26 user nova-compute[75266]:     <apic/>
Nov 28 00:59:26 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 00:59:26 user nova-compute[75266]:   </features>
Nov 28 00:59:26 user nova-compute[75266]:   <clock offset="utc">
Nov 28 00:59:26 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 00:59:26 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 00:59:26 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 00:59:26 user nova-compute[75266]:   </clock>
Nov 28 00:59:26 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 00:59:26 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 00:59:26 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 00:59:26 user nova-compute[75266]:   </cpu>
Nov 28 00:59:26 user nova-compute[75266]:   <devices>
Nov 28 00:59:26 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 00:59:26 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 00:59:26 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk"/>
Nov 28 00:59:26 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 00:59:26 user nova-compute[75266]:     </disk>
Nov 28 00:59:26 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 00:59:26 user nova-compute[75266]:       <mac address="fa:16:3e:80:05:f2"/>
Nov 28 00:59:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:59:26 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 00:59:26 user nova-compute[75266]:       <target dev="tapcbe5cb94-84"/>
Nov 28 00:59:26 user nova-compute[75266]:     </interface>
Nov 28 00:59:26 user nova-compute[75266]:     <serial type="pty">
Nov 28 00:59:26 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/console.log" append="off"/>
Nov 28 00:59:26 user nova-compute[75266]:     </serial>
Nov 28 00:59:26 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 00:59:26 user nova-compute[75266]:     <video>
Nov 28 00:59:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 00:59:26 user nova-compute[75266]:     </video>
Nov 28 00:59:26 user nova-compute[75266]:     <rng model="virtio">
Nov 28 00:59:26 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 00:59:26 user nova-compute[75266]:     </rng>
Nov 28 00:59:26 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 00:59:26 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 00:59:26 user nova-compute[75266]:       <stats period="10"/>
Nov 28 00:59:26 user nova-compute[75266]:     </memballoon>
Nov 28 00:59:26 user nova-compute[75266]:   </devices>
Nov 28 00:59:26 user nova-compute[75266]: </domain>
Nov 28 00:59:26 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401399961',display_name='tempest-ServersNegativeTestJSON-server-1401399961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401399961',id=38,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-g5cch82i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T00:59:25Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=b375c38b-e368-4e2a-b988-0ae27130a878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG os_vif [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6702bf7-15cd-5947-b342-74395e63ced6', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbe5cb94-84, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbe5cb94-84, col_values=(('qos', UUID('4777726c-02a6-447b-8d5d-e10c537af9e8')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbe5cb94-84, col_values=(('external_ids', {'iface-id': 'cbe5cb94-844b-4115-a79a-e58beb743d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:05:f2', 'vm-uuid': 'b375c38b-e368-4e2a-b988-0ae27130a878'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:26 user nova-compute[75266]: INFO os_vif [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84')
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 00:59:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] No VIF found with MAC fa:16:3e:80:05:f2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updated VIF entry in instance network info cache for port cbe5cb94-844b-4115-a79a-e58beb743d42. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updating instance_info_cache with network_info: [{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Releasing lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] No waiting events found dispatching network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:28 user nova-compute[75266]: WARNING nova.compute.manager [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received unexpected event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 for instance with vm_state building and task_state spawning.
Nov 28 00:59:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:30 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Instance spawned successfully.
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] No waiting events found dispatching network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:30 user nova-compute[75266]: WARNING nova.compute.manager [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received unexpected event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 for instance with vm_state building and task_state spawning.
Nov 28 00:59:30 user nova-compute[75266]: INFO nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 28 00:59:30 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:30 user nova-compute[75266]: INFO nova.compute.manager [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Took 6.37 seconds to build instance.
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.468s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:32 user nova-compute[75266]: INFO nova.compute.manager [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Terminating instance
Nov 28 00:59:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-unplugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:59:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Instance destroyed successfully.
Nov 28 00:59:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7008MB free_disk=24.840656280517578GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'resources' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2078984112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2078984112',id=28,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpUFquDeumIIdDQAaGyNyeGGAa5cfVSI7FFpRzGGGZzYV4GV1jUbn8wjNU0WSYASKLUcvewvIMnW8sX+yZuTGWUBWmFHdYqYTml4tXyMStLNULR7tj9BXfQY6FltgCdBQ==',key_name='tempest-keypair-1702320399',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-jiuym071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=5fcab10a-4f5f-479c-9d0c-907bcea7d87e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "ea295632-a11a-4926-b87a-c3fda4b47a47", "address": "fa:16:3e:30:11:20", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea295632-a1", "ovs_interfaceid": "ea295632-a11a-4926-b87a-c3fda4b47a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG os_vif [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea295632-a1, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e8ac7b8-91cf-4be4-ad6c-ab651301215d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:33 user nova-compute[75266]: INFO os_vif [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:11:20,bridge_name='br-int',has_traffic_filtering=True,id=ea295632-a11a-4926-b87a-c3fda4b47a47,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea295632-a1')
Nov 28 00:59:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Deleting instance files /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e_del
Nov 28 00:59:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Deletion of /opt/stack/data/nova/instances/5fcab10a-4f5f-479c-9d0c-907bcea7d87e_del complete
Nov 28 00:59:33 user nova-compute[75266]: INFO nova.compute.manager [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 28 00:59:33 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 500f7840-d86c-4620-b93f-9065ebe4872f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b22014-115e-4871-8dfa-dd14d4c2312e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 00:59:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:34 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Took 0.73 seconds to deallocate network for instance.
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Acquiring lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] No waiting events found dispatching network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:34 user nova-compute[75266]: WARNING nova.compute.manager [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received unexpected event network-vif-plugged-ea295632-a11a-4926-b87a-c3fda4b47a47 for instance with vm_state deleted and task_state None.
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Received event network-vif-deleted-ea295632-a11a-4926-b87a-c3fda4b47a47 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:34 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Deleted allocations for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "5fcab10a-4f5f-479c-9d0c-907bcea7d87e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:34 user nova-compute[75266]: INFO nova.compute.manager [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Terminating instance
Nov 28 00:59:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing instance network info cache due to event network-changed-43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Acquiring lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Acquired lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Refreshing network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:35 user nova-compute[75266]: INFO nova.compute.manager [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Terminating instance
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Instance destroyed successfully.
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-389395682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-389395682',id=31,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:56:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-iwojbrq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:57:49Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=500f7840-d86c-4620-b93f-9065ebe4872f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "address": "fa:16:3e:d3:ca:9b", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b85a0a3-79", "ovs_interfaceid": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG os_vif [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b85a0a3-79, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd78cdea-e2c5-4680-b8be-39448fc2ec8e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: INFO os_vif [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ca:9b,bridge_name='br-int',has_traffic_filtering=True,id=4b85a0a3-79a9-4e29-9559-5d25b03f7db5,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b85a0a3-79')
Nov 28 00:59:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBsquJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:59:35 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42cc200-950e-4e14-b672-f91371806701]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:59:35 user nova-compute[75266]: No targets found.
Nov 28 00:59:35 user nova-compute[75266]: iSNS:
Nov 28 00:59:35 user nova-compute[75266]: No targets found.
Nov 28 00:59:35 user nova-compute[75266]: STATIC:
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 00:59:35 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:35 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:35 user nova-compute[75266]: FIRMWARE:
Nov 28 00:59:35 user nova-compute[75266]: No targets found.
Nov 28 00:59:35 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:59:36 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:59:36 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e95a6-76a8-4e61-a2ff-ade341482b48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1d5af-8490-445c-a6c2-9a55599d30da]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:36 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c59caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b'): ({'sdh'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Removing single pathed devices sdh {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96578ce-d5e6-49a9-9efc-3f8805bc8d2f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b32d0-1fda-418a-af40-0b3ac3fa8dd4]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flushing IO for device /dev/sdh {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4f1bb-2f07-44c8-8baa-2df82634a81a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e87b1e-6df7-495b-8d0d-c3379adf1f90]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] SCSI volumes sdh have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2eee76-07bc-4563-880f-d0560c773726]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updated VIF entry in instance network info cache for port 43845fb0-ef5f-465a-81d7-41ae84e3a7eb. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [{"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Instance destroyed successfully.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.objects.instance [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'resources' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e18c2b-059c-42e3-ba0e-1a0bb56194eb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260]
Nov 28 00:59:36 user nova-compute[75266]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b, portal: 172.16.0.220,3260] successful.
Nov 28 00:59:36 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-293111776',display_name='tempest-TestStampPattern-server-293111776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293111776',id=32,image_ref='d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:56:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-0urxa090',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3702ef7a-256e-4dbe-9b8c-2980c83ddb84',image_min_disk='1',image_min_ram='0',image_owner_id='7a6914d589cc40088c765d5ae8fdd28c',image_owner_project_name='tempest-TestStampPattern-1934253251',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1934253251-project-member',image_user_id='725ae105f36b4b1ca7422d6237a51ff8',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:56:47Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=a2decc79-0682-4b5a-a9e1-84c0738bc32f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "address": "fa:16:3e:6a:6b:a0", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43845fb0-ef", "ovs_interfaceid": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_vif [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Releasing lock "refresh_cache-a2decc79-0682-4b5a-a9e1-84c0738bc32f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43845fb0-ef, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46a4bf6c-754d-4093-be13-a5ad49baf90d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86af50f-7d6b-47e2-b25e-e6b6bc69d03b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[addc503f-35c7-4a05-abc8-b27753a4ffa9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== disconnect_volume: return (399ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Deleting instance files /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f_del
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Deletion of /opt/stack/data/nova/instances/500f7840-d86c-4620-b93f-9065ebe4872f_del complete
Nov 28 00:59:36 user nova-compute[75266]: INFO os_vif [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43845fb0-ef')
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Deleting instance files /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f_del
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Deletion of /opt/stack/data/nova/instances/a2decc79-0682-4b5a-a9e1-84c0738bc32f_del complete
Nov 28 00:59:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.compute.manager [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.compute.manager [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-unplugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Acquiring lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "500f7840-d86c-4620-b93f-9065ebe4872f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] No waiting events found dispatching network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:36 user nova-compute[75266]: WARNING nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received unexpected event network-vif-plugged-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance with vm_state active and task_state deleting.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-unplugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] No waiting events found dispatching network-vif-unplugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-unplugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Acquiring lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] No waiting events found dispatching network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:36 user nova-compute[75266]: WARNING nova.compute.manager [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received unexpected event network-vif-plugged-43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance with vm_state active and task_state deleting.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Took 0.41 seconds to deallocate network for instance.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Took 0.52 seconds to deallocate network for instance.
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Received event network-vif-deleted-43845fb0-ef5f-465a-81d7-41ae84e3a7eb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:36 user nova-compute[75266]: INFO nova.compute.manager [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Neutron deleted interface 43845fb0-ef5f-465a-81d7-41ae84e3a7eb; detaching it from the instance and deleting it from the info cache
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Detach interface failed, port_id=43845fb0-ef5f-465a-81d7-41ae84e3a7eb, reason: Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 00:59:37 user nova-compute[75266]: INFO nova.compute.manager [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Terminating instance
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:37 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Deleted allocations for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "a2decc79-0682-4b5a-a9e1-84c0738bc32f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [{"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:37 user nova-compute[75266]: INFO nova.compute.manager [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Took 0.94 seconds to detach 1 volumes for instance.
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-19151248-a33d-46b2-be99-0a85a5ab88d3" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Instance destroyed successfully.
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'resources' on Instance uuid 08844c7b-f7ca-4c50-ac58-eccff6064ec4 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-965644235',display_name='tempest-ServerActionsTestOtherA-server-965644235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-965644235',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-rznjn1pp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:56:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=08844c7b-f7ca-4c50-ac58-eccff6064ec4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "address": "fa:16:3e:6d:ab:83", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f437b2e-0b", "ovs_interfaceid": "2f437b2e-0b70-4d62-8011-839cbc9a06bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 00:59:37 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_vif [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f437b2e-0b, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ded3bd5-cbbb-401c-99c6-64aed4d4dda1) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:38 user nova-compute[75266]: INFO os_vif [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=2f437b2e-0b70-4d62-8011-839cbc9a06bb,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f437b2e-0b')
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ShpULPrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 00:59:38 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b422b-18a1-4e0e-b0a2-2c69164f5a48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 00:59:38 user nova-compute[75266]: No targets found.
Nov 28 00:59:38 user nova-compute[75266]: iSNS:
Nov 28 00:59:38 user nova-compute[75266]: No targets found.
Nov 28 00:59:38 user nova-compute[75266]: STATIC:
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 00:59:38 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 00:59:38 user nova-compute[75266]:                 Iface Name: default
Nov 28 00:59:38 user nova-compute[75266]: FIRMWARE:
Nov 28 00:59:38 user nova-compute[75266]: No targets found.
Nov 28 00:59:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 00:59:38 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 00:59:38 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f038a548-30b0-4a44-a2ed-db5feaee0793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845d833-0bb1-47d3-9294-d691e570ce49]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 00:59:38 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 00:59:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c23cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b41bc9f-93be-4f1a-ae2a-008fe55a4229]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c16c78e-002e-4871-b8b7-95b7ac00486b]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d9ba4b-6af3-45cf-9dd6-5f2fefbf7391]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e5737-be31-48c2-a479-2bd4e01a9c2c]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb8458-be56-424e-9ebd-11af6e4ad4d6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a475b-664d-40a3-bc20-6bc0b817084a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260]
Nov 28 00:59:38 user nova-compute[75266]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c, portal: 172.16.0.220,3260] successful.
Nov 28 00:59:38 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 00:59:38 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Deleted allocations for instance 500f7840-d86c-4620-b93f-9065ebe4872f
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf2ecb0-05e5-411a-9dfb-33928d958c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[443577e8-6bf7-4834-b95b-6bd4f5cea5d3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] <== disconnect_volume: return (364ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 00:59:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Deleting instance files /opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4_del
Nov 28 00:59:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Deletion of /opt/stack/data/nova/instances/08844c7b-f7ca-4c50-ac58-eccff6064ec4_del complete
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "500f7840-d86c-4620-b93f-9065ebe4872f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.469s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:38 user nova-compute[75266]: INFO nova.compute.manager [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Received event network-vif-deleted-4b85a0a3-79a9-4e29-9559-5d25b03f7db5 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-unplugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Acquiring lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] No waiting events found dispatching network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 00:59:38 user nova-compute[75266]: WARNING nova.compute.manager [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received unexpected event network-vif-plugged-2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance with vm_state active and task_state deleting.
Nov 28 00:59:39 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 00:59:39 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Took 0.79 seconds to deallocate network for instance.
Nov 28 00:59:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Received event network-vif-deleted-2f437b2e-0b70-4d62-8011-839cbc9a06bb {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 00:59:40 user nova-compute[75266]: INFO nova.compute.manager [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 00:59:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Deleting volume: cbf2ecb0-05e5-411a-9dfb-33928d958c2c {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 00:59:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 00:59:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 00:59:40 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 00:59:40 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 00:59:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:40 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Deleted allocations for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4
Nov 28 00:59:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "08844c7b-f7ca-4c50-ac58-eccff6064ec4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.744s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 00:59:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 00:59:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing instance network info cache due to event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:09 user nova-compute[75266]: DEBUG nova.network.neutron [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updated VIF entry in instance network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:10 user nova-compute[75266]: INFO nova.compute.manager [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Shelve offloading
Nov 28 01:00:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance destroyed successfully.
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:11 user nova-compute[75266]: WARNING nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state active and task_state shelving.
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:11 user nova-compute[75266]: WARNING nova.compute.manager [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state active and task_state shelving.
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance destroyed successfully.
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'resources' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KNQqJEkWGmzZifPUVaLA75cWARw0qE/b2TEuxTimAKA+NMfhXs8WJnpbDfmPzdEvNU0XTfO37MxPtD+1IFavGk4iz1iq94AyP1MZC1OnuSEjEHHqIHb9E/bv4urgRBw==',key_name='tempest-TestShelveInstance-2097820211',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:58:32Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_vif [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a1cff7-65, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing instance network info cache due to event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.network.neutron [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b88b1829-2138-4b70-8674-07a792e23a00) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:12 user nova-compute[75266]: INFO os_vif [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65')
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:00:12 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc79f9b-a3c9-40e4-bba8-e0d1dba2f0d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:00:12 user nova-compute[75266]: No targets found.
Nov 28 01:00:12 user nova-compute[75266]: iSNS:
Nov 28 01:00:12 user nova-compute[75266]: No targets found.
Nov 28 01:00:12 user nova-compute[75266]: STATIC:
Nov 28 01:00:12 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 01:00:12 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:12 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:12 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 01:00:12 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:12 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:12 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b
Nov 28 01:00:12 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:12 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:12 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 01:00:12 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:12 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:12 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:00:12 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:12 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:12 user nova-compute[75266]: FIRMWARE:
Nov 28 01:00:12 user nova-compute[75266]: No targets found.
Nov 28 01:00:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:00:12 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:00:12 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4736c419-0052-43d5-9a36-d2c3a77dc7c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6012d67-ebad-437b-944c-a2ec16170c40]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 01:00:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:00:12 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 01:00:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bac125750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b'): ({'sdf'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Removing single pathed devices sdf {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e12494-5993-40bf-8012-2ae5900bde82]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8837ce9-174b-4419-9989-003fb480e529]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flushing IO for device /dev/sdf {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d17b42-d520-470b-9ef5-f6a17d5330ff]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e670d0-6f0c-4a8e-b108-c8755a532c15]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] SCSI volumes sdf have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9a785-c3b2-4a48-8da8-3bcd501385f8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9245bfb3-1beb-46e8-b4de-75f712b2a48f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]
Nov 28 01:00:12 user nova-compute[75266]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.
Nov 28 01:00:12 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c428d-f8b1-4f9e-9460-475dc9519442]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== disconnect_volume: return (335ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:00:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deleting instance files /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d_del
Nov 28 01:00:12 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deletion of /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d_del complete
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.network.neutron [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updated VIF entry in instance network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG nova.network.neutron [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": null, "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap64a1cff7-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:13 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Deleted allocations for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d
Nov 28 01:00:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:13 user nova-compute[75266]: DEBUG nova.objects.base [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Object Instance<1e61e82c-a198-4f76-a2b8-84b3c58be36d> lazy-loaded attributes: resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:00:14 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:14 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.909s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:00:25 user nova-compute[75266]: INFO nova.compute.claims [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Claim successful on node user
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:25 user nova-compute[75266]: INFO nova.compute.manager [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Terminating instance
Nov 28 01:00:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-unplugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] No waiting events found dispatching network-vif-unplugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-unplugged-1137e441-e2d4-4e41-b478-54485b3612f7 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.policy [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Creating image(s)
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Instance destroyed successfully.
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid a5c9b82c-581e-4e29-8d34-286a293a33f9 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423929614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423929614',id=25,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-2ae948lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:53:00Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=a5c9b82c-581e-4e29-8d34-286a293a33f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "1137e441-e2d4-4e41-b478-54485b3612f7", "address": "fa:16:3e:5d:68:2d", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1137e441-e2", "ovs_interfaceid": "1137e441-e2d4-4e41-b478-54485b3612f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG os_vif [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1137e441-e2, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a90579bc-0f9b-46d8-99dd-de5b43256318) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:26 user nova-compute[75266]: INFO os_vif [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:68:2d,bridge_name='br-int',has_traffic_filtering=True,id=1137e441-e2d4-4e41-b478-54485b3612f7,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1137e441-e2')
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Deleting instance files /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9_del
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Deletion of /opt/stack/data/nova/instances/a5c9b82c-581e-4e29-8d34-286a293a33f9_del complete
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.232s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:26 user nova-compute[75266]: INFO nova.compute.manager [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 01:00:26 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:00:26 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.215s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk 1073741824" returned: 0 in 0.052s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:27 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Took 0.52 seconds to deallocate network for instance.
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Cannot resize image /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Ensure instance console log exists: /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-deleted-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Successfully created port: c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.153s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:27 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:00:27 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Deleted allocations for instance a5c9b82c-581e-4e29-8d34-286a293a33f9
Nov 28 01:00:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Successfully updated port: c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing instance network info cache due to event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Acquiring lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Lock "a5c9b82c-581e-4e29-8d34-286a293a33f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] No waiting events found dispatching network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:28 user nova-compute[75266]: WARNING nova.compute.manager [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Received unexpected event network-vif-plugged-1137e441-e2d4-4e41-b478-54485b3612f7 for instance with vm_state deleted and task_state None.
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance network_info: |[{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.neutron [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start _get_guest_xml network_info=[{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:00:28 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:00:28 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOoiDu67tR7mPD4Ahv+EVZUaBKP+XiaC7SnbsuKk5Kg2EZdBaWQrDdK48Zxa29VqFkJ235tL35fWdJopN9ifTRlqKpakxgM0g7GrZpLW8OW5tlrTl4wl5Xg24x+8AWTJA==',key_name='tempest-keypair-1399423202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_devices' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:00:28 user nova-compute[75266]:   <uuid>15050b6f-4cc9-45e8-81f0-56ef01c3f703</uuid>
Nov 28 01:00:28 user nova-compute[75266]:   <name>instance-00000027</name>
Nov 28 01:00:28 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:00:28 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:00:28 user nova-compute[75266]:   <metadata>
Nov 28 01:00:28 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:00:28 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-229525217</nova:name>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:00:28</nova:creationTime>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:00:28 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:00:28 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:owner>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:user uuid="1fd50f4f867e4efcad9e16d45dde6df0">tempest-AttachVolumeShelveTestJSON-107867446-project-member</nova:user>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:project uuid="52c236f1599d4a4fb181b4aa73058211">tempest-AttachVolumeShelveTestJSON-107867446</nova:project>
Nov 28 01:00:28 user nova-compute[75266]:       </nova:owner>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:00:28 user nova-compute[75266]:       <nova:ports>
Nov 28 01:00:28 user nova-compute[75266]:         <nova:port uuid="c212acf4-cf66-4cc0-8038-45ad6868166b">
Nov 28 01:00:28 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 01:00:28 user nova-compute[75266]:         </nova:port>
Nov 28 01:00:28 user nova-compute[75266]:       </nova:ports>
Nov 28 01:00:28 user nova-compute[75266]:     </nova:instance>
Nov 28 01:00:28 user nova-compute[75266]:   </metadata>
Nov 28 01:00:28 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:00:28 user nova-compute[75266]:     <system>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="serial">15050b6f-4cc9-45e8-81f0-56ef01c3f703</entry>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="uuid">15050b6f-4cc9-45e8-81f0-56ef01c3f703</entry>
Nov 28 01:00:28 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:00:28 user nova-compute[75266]:     </system>
Nov 28 01:00:28 user nova-compute[75266]:   </sysinfo>
Nov 28 01:00:28 user nova-compute[75266]:   <os>
Nov 28 01:00:28 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:00:28 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:00:28 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:00:28 user nova-compute[75266]:   </os>
Nov 28 01:00:28 user nova-compute[75266]:   <features>
Nov 28 01:00:28 user nova-compute[75266]:     <acpi/>
Nov 28 01:00:28 user nova-compute[75266]:     <apic/>
Nov 28 01:00:28 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:00:28 user nova-compute[75266]:   </features>
Nov 28 01:00:28 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:00:28 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:00:28 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:00:28 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:00:28 user nova-compute[75266]:   </clock>
Nov 28 01:00:28 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:00:28 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:00:28 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:00:28 user nova-compute[75266]:   </cpu>
Nov 28 01:00:28 user nova-compute[75266]:   <devices>
Nov 28 01:00:28 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:00:28 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:00:28 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk"/>
Nov 28 01:00:28 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:00:28 user nova-compute[75266]:     </disk>
Nov 28 01:00:28 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:00:28 user nova-compute[75266]:       <mac address="fa:16:3e:53:17:ac"/>
Nov 28 01:00:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:00:28 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:00:28 user nova-compute[75266]:       <target dev="tapc212acf4-cf"/>
Nov 28 01:00:28 user nova-compute[75266]:     </interface>
Nov 28 01:00:28 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:00:28 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/console.log" append="off"/>
Nov 28 01:00:28 user nova-compute[75266]:     </serial>
Nov 28 01:00:28 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:00:28 user nova-compute[75266]:     <video>
Nov 28 01:00:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:00:28 user nova-compute[75266]:     </video>
Nov 28 01:00:28 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:00:28 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:00:28 user nova-compute[75266]:     </rng>
Nov 28 01:00:28 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:00:28 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:00:28 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:00:28 user nova-compute[75266]:     </memballoon>
Nov 28 01:00:28 user nova-compute[75266]:   </devices>
Nov 28 01:00:28 user nova-compute[75266]: </domain>
Nov 28 01:00:28 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOoiDu67tR7mPD4Ahv+EVZUaBKP+XiaC7SnbsuKk5Kg2EZdBaWQrDdK48Zxa29VqFkJ235tL35fWdJopN9ifTRlqKpakxgM0g7GrZpLW8OW5tlrTl4wl5Xg24x+8AWTJA==',key_name='tempest-keypair-1399423202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG os_vif [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4470fff1-f138-5045-8e54-2711ad8a4e3e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc212acf4-cf, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc212acf4-cf, col_values=(('qos', UUID('7d785a32-5c65-4b94-aede-53efd3d7e6b8')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc212acf4-cf, col_values=(('external_ids', {'iface-id': 'c212acf4-cf66-4cc0-8038-45ad6868166b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:17:ac', 'vm-uuid': '15050b6f-4cc9-45e8-81f0-56ef01c3f703'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:28 user nova-compute[75266]: INFO os_vif [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf')
Nov 28 01:00:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No VIF found with MAC fa:16:3e:53:17:ac, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG nova.network.neutron [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updated VIF entry in instance network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG nova.network.neutron [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:30 user nova-compute[75266]: WARNING nova.compute.manager [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state building and task_state spawning.
Nov 28 01:00:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:00:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:33 user nova-compute[75266]: WARNING nova.compute.manager [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state building and task_state spawning.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:00:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:00:33 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=7692MB free_disk=24.948657989501953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance spawned successfully.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.compute.manager [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Terminating instance
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b22014-115e-4871-8dfa-dd14d4c2312e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.compute.manager [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Took 7.57 seconds to build instance.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.684s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-unplugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] No waiting events found dispatching network-vif-unplugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-unplugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Instance destroyed successfully.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'resources' on Instance uuid 19151248-a33d-46b2-be99-0a85a5ab88d3 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1516510796',display_name='tempest-ServerActionsTestOtherA-server-1516510796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1516510796',id=5,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA==',key_name='tempest-keypair-1133257069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22c31829ff0846fc8584d492bea6cdc4',ramdisk_id='',reservation_id='r-5kd1km50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-277302336',owner_user_name='tempest-ServerActionsTestOtherA-277302336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a0e9261934c8b8e673f069c3376bd',uuid=19151248-a33d-46b2-be99-0a85a5ab88d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converting VIF {"id": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "address": "fa:16:3e:bf:a9:5a", "network": {"id": "1fef710f-91b8-46ea-a616-1a2c3c3ff203", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-213784539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22c31829ff0846fc8584d492bea6cdc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fc4f41-e0", "ovs_interfaceid": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG os_vif [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6fc4f41-e0, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=827a1920-0d90-4b32-91d0-de97522faba2) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:33 user nova-compute[75266]: INFO os_vif [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:a9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e6fc4f41-e0f9-4d3e-9361-e29c116e19ef,network=Network(1fef710f-91b8-46ea-a616-1a2c3c3ff203),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6fc4f41-e0')
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Deleting instance files /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3_del
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Deletion of /opt/stack/data/nova/instances/19151248-a33d-46b2-be99-0a85a5ab88d3_del complete
Nov 28 01:00:33 user nova-compute[75266]: INFO nova.compute.manager [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 01:00:33 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:00:33 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:34 user nova-compute[75266]: INFO nova.compute.manager [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Terminating instance
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:34 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Took 0.66 seconds to deallocate network for instance.
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing instance network info cache due to event network-changed-2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Acquiring lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Acquired lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Refreshing network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Instance destroyed successfully.
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'resources' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-191779408',display_name='tempest-TestStampPattern-server-191779408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-191779408',id=29,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA==',key_name='tempest-TestStampPattern-1933151860',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a6914d589cc40088c765d5ae8fdd28c',ramdisk_id='',reservation_id='r-bnr3eycd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1934253251',owner_user_name='tempest-TestStampPattern-1934253251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:56:35Z,user_data=None,user_id='725ae105f36b4b1ca7422d6237a51ff8',uuid=3702ef7a-256e-4dbe-9b8c-2980c83ddb84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converting VIF {"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:34 user nova-compute[75266]: DEBUG os_vif [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c602f33-1c, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eafa036d-27cf-4589-9cb4-ea232fb97037) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:35 user nova-compute[75266]: INFO os_vif [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:ab,bridge_name='br-int',has_traffic_filtering=True,id=2c602f33-1cb2-4d10-b074-9348e302816a,network=Network(d65f0111-ef66-4c05-8da0-00fdbf788b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c602f33-1c')
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Deleting instance files /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84_del
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Deletion of /opt/stack/data/nova/instances/3702ef7a-256e-4dbe-9b8c-2980c83ddb84_del complete
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.compute.manager [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updated VIF entry in instance network info cache for port 2c602f33-1cb2-4d10-b074-9348e302816a. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [{"id": "2c602f33-1cb2-4d10-b074-9348e302816a", "address": "fa:16:3e:cd:cd:ab", "network": {"id": "d65f0111-ef66-4c05-8da0-00fdbf788b0b", "bridge": "br-int", "label": "tempest-TestStampPattern-1060398014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a6914d589cc40088c765d5ae8fdd28c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c602f33-1c", "ovs_interfaceid": "2c602f33-1cb2-4d10-b074-9348e302816a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Releasing lock "refresh_cache-3702ef7a-256e-4dbe-9b8c-2980c83ddb84" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-deleted-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Acquiring lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] No waiting events found dispatching network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:35 user nova-compute[75266]: WARNING nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Received unexpected event network-vif-plugged-e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance with vm_state deleted and task_state None.
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-unplugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] No waiting events found dispatching network-vif-unplugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-unplugged-2c602f33-1cb2-4d10-b074-9348e302816a for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Acquiring lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] No waiting events found dispatching network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:35 user nova-compute[75266]: WARNING nova.compute.manager [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received unexpected event network-vif-plugged-2c602f33-1cb2-4d10-b074-9348e302816a for instance with vm_state active and task_state deleting.
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Deleted allocations for instance 19151248-a33d-46b2-be99-0a85a5ab88d3
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "19151248-a33d-46b2-be99-0a85a5ab88d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Took 0.76 seconds to deallocate network for instance.
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Received event network-vif-deleted-2c602f33-1cb2-4d10-b074-9348e302816a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:35 user nova-compute[75266]: INFO nova.compute.manager [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Neutron deleted interface 2c602f33-1cb2-4d10-b074-9348e302816a; detaching it from the instance and deleting it from the info cache
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Detach interface failed, port_id=2c602f33-1cb2-4d10-b074-9348e302816a, reason: Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [{"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-92237bf8-8ea4-4f79-938d-6dfe03edd31d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:36 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Deleted allocations for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84
Nov 28 01:00:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3702ef7a-256e-4dbe-9b8c-2980c83ddb84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-changed-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Refreshing instance network info cache due to event network-changed-f19fff11-b050-4a94-9fad-1bdb14c14f72. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Acquiring lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Acquired lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.network.neutron [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Refreshing network info cache for port f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.network.neutron [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updated VIF entry in instance network info cache for port f19fff11-b050-4a94-9fad-1bdb14c14f72. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.network.neutron [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating instance_info_cache with network_info: [{"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Releasing lock "refresh_cache-60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:39 user nova-compute[75266]: INFO nova.compute.manager [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Terminating instance
Nov 28 01:00:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Instance destroyed successfully.
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.objects.instance [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1947899743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1947899743',id=36,image_ref='c147252c-f6ee-4636-bb61-7d559394663a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy1apJVpf98tjT3O9I7ncn5SN4dSBHY9Yj0vxMq6JMtxNahVKM1GH5RAuf8kRxS9rGJGRcunlLXZQQV0rfE2RW5xi41ldPgN0diD7Q+JsGAeuRkXhRJQUBTPVe25N4gcQ==',key_name='tempest-keypair-755313768',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-let50sqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156826038',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "address": "fa:16:3e:63:58:4b", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19fff11-b0", "ovs_interfaceid": "f19fff11-b050-4a94-9fad-1bdb14c14f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_vif [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf19fff11-b0, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e15e2dae-3c80-45b6-be84-b3dfb8a6decf) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:40 user nova-compute[75266]: INFO os_vif [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:58:4b,bridge_name='br-int',has_traffic_filtering=True,id=f19fff11-b050-4a94-9fad-1bdb14c14f72,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19fff11-b0')
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wAyaQLxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:00:40 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9321a67-bbea-404a-b985-f6d90ee62d12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:00:40 user nova-compute[75266]: No targets found.
Nov 28 01:00:40 user nova-compute[75266]: iSNS:
Nov 28 01:00:40 user nova-compute[75266]: No targets found.
Nov 28 01:00:40 user nova-compute[75266]: STATIC:
Nov 28 01:00:40 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 01:00:40 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:40 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:40 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 01:00:40 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:40 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:40 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b
Nov 28 01:00:40 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:40 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:40 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:00:40 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:00:40 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:00:40 user nova-compute[75266]: FIRMWARE:
Nov 28 01:00:40 user nova-compute[75266]: No targets found.
Nov 28 01:00:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:00:40 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:00:40 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49b6cd-6855-4fa4-9002-3d5dd7538add]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e57e87-02f8-403a-8057-7294b0994f6c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 01:00:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:00:40 user nova-compute[75266]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b (non-flash)
Nov 28 01:00:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bb678a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3becd19e-d0c1-4ced-8f9b-9a7a29bd15f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a7063-e7d0-4cf1-b9bb-0a2f759a8b54]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ac4df-393b-48d4-9291-8d7fc5a60aad]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb6d6e-5c02-4dba-bea0-df2f5ffcbc31]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a836a-6fcc-4f20-8d08-5db9b11833e3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[224df965-0f3b-4e3a-a400-3872056e54f9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260]
Nov 28 01:00:40 user nova-compute[75266]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b, portal: 172.16.0.220,3260] successful.
Nov 28 01:00:40 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59405c9b-8d98-4dd5-b9a7-8c346cfc205b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd7c69-3144-419e-ba77-55271d735193]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (302ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:00:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Deleting instance files /opt/stack/data/nova/instances/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20_del
Nov 28 01:00:40 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Deletion of /opt/stack/data/nova/instances/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20_del complete
Nov 28 01:00:40 user nova-compute[75266]: INFO nova.compute.manager [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 01:00:40 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:00:40 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-unplugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] No waiting events found dispatching network-vif-unplugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-unplugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Acquiring lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] No waiting events found dispatching network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:41 user nova-compute[75266]: WARNING nova.compute.manager [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received unexpected event network-vif-plugged-f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance with vm_state active and task_state deleting.
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Received event network-vif-deleted-f19fff11-b050-4a94-9fad-1bdb14c14f72 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:41 user nova-compute[75266]: INFO nova.compute.manager [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Neutron deleted interface f19fff11-b050-4a94-9fad-1bdb14c14f72; detaching it from the instance and deleting it from the info cache
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:41 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Took 0.69 seconds to deallocate network for instance.
Nov 28 01:00:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Detach interface failed, port_id=f19fff11-b050-4a94-9fad-1bdb14c14f72, reason: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 01:00:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:42 user nova-compute[75266]: INFO nova.compute.manager [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Took 0.81 seconds to detach 1 volumes for instance.
Nov 28 01:00:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Deleting volume: 59405c9b-8d98-4dd5-b9a7-8c346cfc205b {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 01:00:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:42 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:42 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:42 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20
Nov 28 01:00:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-changed-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Refreshing instance network info cache due to event network-changed-403dbea6-2bda-4b17-9d20-e17ae32d6e73. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Acquiring lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Acquired lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Refreshing network info cache for port 403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:43 user nova-compute[75266]: INFO nova.compute.manager [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Terminating instance
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-unplugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] No waiting events found dispatching network-vif-unplugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-unplugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updated VIF entry in instance network info cache for port 403dbea6-2bda-4b17-9d20-e17ae32d6e73. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updating instance_info_cache with network_info: [{"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Releasing lock "refresh_cache-ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Instance destroyed successfully.
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.objects.instance [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'resources' on Instance uuid ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-625351436',display_name='tempest-AttachVolumeNegativeTest-server-625351436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-625351436',id=37,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSpAopraW6cNHBCbcsQ7cRNBLTfzxnb3VVz6xYSxROk9zSsm8WrrtUdXPXyVFQd/08QBbchhzBNuPIdsQS1cS6wTd+5XTV6jLa4pMhL3tQfjQwEyy4G4ybftgCqIf3aw==',key_name='tempest-keypair-509848427',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:58:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-awe04lve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "address": "fa:16:3e:56:34:b2", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403dbea6-2b", "ovs_interfaceid": "403dbea6-2bda-4b17-9d20-e17ae32d6e73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG os_vif [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap403dbea6-2b, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f132e50b-d1d4-412c-9153-83d982de55d4) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:00:44 user nova-compute[75266]: INFO os_vif [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:34:b2,bridge_name='br-int',has_traffic_filtering=True,id=403dbea6-2bda-4b17-9d20-e17ae32d6e73,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap403dbea6-2b')
Nov 28 01:00:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Deleting instance files /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c_del
Nov 28 01:00:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Deletion of /opt/stack/data/nova/instances/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c_del complete
Nov 28 01:00:44 user nova-compute[75266]: INFO nova.compute.manager [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 01:00:44 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:00:44 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:00:45 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Took 1.14 seconds to deallocate network for instance.
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-deleted-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Acquiring lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] No waiting events found dispatching network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:00:45 user nova-compute[75266]: WARNING nova.compute.manager [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Received unexpected event network-vif-plugged-403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance with vm_state deleted and task_state None.
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:00:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:45 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Deleted allocations for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c
Nov 28 01:00:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.634s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:00:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:00:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:01:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:01:15 user nova-compute[75266]: INFO nova.compute.claims [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Claim successful on node user
Nov 28 01:01:15 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:01:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.policy [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:01:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Creating image(s)
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "/opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "/opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "/opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:16 user nova-compute[75266]: INFO nova.compute.manager [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Terminating instance
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk 1073741824" returned: 0 in 0.058s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Successfully created port: 9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-unplugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Cannot resize image /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Ensure instance console log exists: /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Instance destroyed successfully.
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1413117774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1413117774',id=16,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-7fzl3ejn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:49:12Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=92237bf8-8ea4-4f79-938d-6dfe03edd31d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "address": "fa:16:3e:9f:c8:ec", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57d7084-7f", "ovs_interfaceid": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_vif [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd57d7084-7f, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=734176a0-59d4-4a78-b809-6dbf46d90201) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:17 user nova-compute[75266]: INFO os_vif [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c8:ec,bridge_name='br-int',has_traffic_filtering=True,id=d57d7084-7f1f-4e79-9770-0fe51e5f13fc,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57d7084-7f')
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpnRgKLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:01:17 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6b4b3c-976c-4a0c-899e-081361f7753e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:01:17 user nova-compute[75266]: No targets found.
Nov 28 01:01:17 user nova-compute[75266]: iSNS:
Nov 28 01:01:17 user nova-compute[75266]: No targets found.
Nov 28 01:01:17 user nova-compute[75266]: STATIC:
Nov 28 01:01:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974
Nov 28 01:01:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 01:01:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:17 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:01:17 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:17 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:17 user nova-compute[75266]: FIRMWARE:
Nov 28 01:01:17 user nova-compute[75266]: No targets found.
Nov 28 01:01:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:01:17 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:01:17 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[483ec05a-7871-43f0-9c10-0cc4c4690529]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f839cc-5ac4-4d19-ae04-410b02f04346]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:01:17 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:01:17 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 (non-flash)
Nov 28 01:01:17 user nova-compute[75266]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:01:17 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c340f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51f1b9-ed55-4fa3-953e-24a181b22f93]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c7b604-df8d-4090-96e1-6dbe50623905]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f419359-677e-4893-bbd6-289446ec26c6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f934438-5fe7-4d49-85a0-0b3b22234730]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36755f5-6d8b-4f89-944d-23c5a619f8a3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[256381e3-c564-426b-870c-b63d2d98617e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260]
Nov 28 01:01:17 user nova-compute[75266]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974, portal: 172.16.0.220,3260] successful.
Nov 28 01:01:17 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04532fc5-654b-46d5-a1c4-32bbf6318974 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6c070-9ed9-4ab9-beb6-891baac3c9a5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] <== disconnect_volume: return (290ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:01:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Deleting instance files /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d_del
Nov 28 01:01:17 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Deletion of /opt/stack/data/nova/instances/92237bf8-8ea4-4f79-938d-6dfe03edd31d_del complete
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Successfully updated port: 9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquired lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received event network-changed-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.compute.manager [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Refreshing instance network info cache due to event network-changed-9d081e56-9df8-4170-90cc-83bc418127c0. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Acquiring lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:01:17 user nova-compute[75266]: INFO nova.compute.manager [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Updating instance_info_cache with network_info: [{"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Releasing lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Instance network_info: |[{"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Acquired lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.network.neutron [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Refreshing network info cache for port 9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Start _get_guest_xml network_info=[{"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:01:17 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:01:17 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:01:17 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-956573247',display_name='tempest-ServersNegativeTestJSON-server-956573247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-956573247',id=40,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-hkg2s98b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:01:16Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=f336a024-e3e9-4ac1-9aad-a7e1d465253f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.objects.instance [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lazy-loading 'pci_devices' on Instance uuid f336a024-e3e9-4ac1-9aad-a7e1d465253f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:01:18 user nova-compute[75266]:   <uuid>f336a024-e3e9-4ac1-9aad-a7e1d465253f</uuid>
Nov 28 01:01:18 user nova-compute[75266]:   <name>instance-00000028</name>
Nov 28 01:01:18 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:01:18 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:01:18 user nova-compute[75266]:   <metadata>
Nov 28 01:01:18 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:01:18 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:name>tempest-ServersNegativeTestJSON-server-956573247</nova:name>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:01:17</nova:creationTime>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:01:18 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:01:18 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:owner>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:user uuid="8679237c178f427a9cc7887c21fe12cf">tempest-ServersNegativeTestJSON-647957928-project-member</nova:user>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:project uuid="eaf19f7d462f4fa2a9204479d1d35811">tempest-ServersNegativeTestJSON-647957928</nova:project>
Nov 28 01:01:18 user nova-compute[75266]:       </nova:owner>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:01:18 user nova-compute[75266]:       <nova:ports>
Nov 28 01:01:18 user nova-compute[75266]:         <nova:port uuid="9d081e56-9df8-4170-90cc-83bc418127c0">
Nov 28 01:01:18 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 01:01:18 user nova-compute[75266]:         </nova:port>
Nov 28 01:01:18 user nova-compute[75266]:       </nova:ports>
Nov 28 01:01:18 user nova-compute[75266]:     </nova:instance>
Nov 28 01:01:18 user nova-compute[75266]:   </metadata>
Nov 28 01:01:18 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:01:18 user nova-compute[75266]:     <system>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="serial">f336a024-e3e9-4ac1-9aad-a7e1d465253f</entry>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="uuid">f336a024-e3e9-4ac1-9aad-a7e1d465253f</entry>
Nov 28 01:01:18 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:01:18 user nova-compute[75266]:     </system>
Nov 28 01:01:18 user nova-compute[75266]:   </sysinfo>
Nov 28 01:01:18 user nova-compute[75266]:   <os>
Nov 28 01:01:18 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:01:18 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:01:18 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:01:18 user nova-compute[75266]:   </os>
Nov 28 01:01:18 user nova-compute[75266]:   <features>
Nov 28 01:01:18 user nova-compute[75266]:     <acpi/>
Nov 28 01:01:18 user nova-compute[75266]:     <apic/>
Nov 28 01:01:18 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:01:18 user nova-compute[75266]:   </features>
Nov 28 01:01:18 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:01:18 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:01:18 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:01:18 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:01:18 user nova-compute[75266]:   </clock>
Nov 28 01:01:18 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:01:18 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:01:18 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:01:18 user nova-compute[75266]:   </cpu>
Nov 28 01:01:18 user nova-compute[75266]:   <devices>
Nov 28 01:01:18 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:01:18 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:01:18 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk"/>
Nov 28 01:01:18 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:01:18 user nova-compute[75266]:     </disk>
Nov 28 01:01:18 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:01:18 user nova-compute[75266]:       <mac address="fa:16:3e:74:40:c4"/>
Nov 28 01:01:18 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:01:18 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:01:18 user nova-compute[75266]:       <target dev="tap9d081e56-9d"/>
Nov 28 01:01:18 user nova-compute[75266]:     </interface>
Nov 28 01:01:18 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:01:18 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/console.log" append="off"/>
Nov 28 01:01:18 user nova-compute[75266]:     </serial>
Nov 28 01:01:18 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:01:18 user nova-compute[75266]:     <video>
Nov 28 01:01:18 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:01:18 user nova-compute[75266]:     </video>
Nov 28 01:01:18 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:01:18 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:01:18 user nova-compute[75266]:     </rng>
Nov 28 01:01:18 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:01:18 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:01:18 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:01:18 user nova-compute[75266]:     </memballoon>
Nov 28 01:01:18 user nova-compute[75266]:   </devices>
Nov 28 01:01:18 user nova-compute[75266]: </domain>
Nov 28 01:01:18 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-956573247',display_name='tempest-ServersNegativeTestJSON-server-956573247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-956573247',id=40,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-hkg2s98b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:01:16Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=f336a024-e3e9-4ac1-9aad-a7e1d465253f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG os_vif [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9d52497-36ca-5df3-a5f6-0b5e92060fec', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d081e56-9d, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d081e56-9d, col_values=(('qos', UUID('31c6fa44-f6cd-4ea2-b6cf-a6e2e187ce95')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d081e56-9d, col_values=(('external_ids', {'iface-id': '9d081e56-9df8-4170-90cc-83bc418127c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:40:c4', 'vm-uuid': 'f336a024-e3e9-4ac1-9aad-a7e1d465253f'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:18 user nova-compute[75266]: INFO os_vif [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d')
Nov 28 01:01:18 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Took 0.43 seconds to deallocate network for instance.
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] No VIF found with MAC fa:16:3e:74:40:c4, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Updated VIF entry in instance network info cache for port 9d081e56-9df8-4170-90cc-83bc418127c0. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Updating instance_info_cache with network_info: [{"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Releasing lock "refresh_cache-f336a024-e3e9-4ac1-9aad-a7e1d465253f" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:01:18 user nova-compute[75266]: INFO nova.compute.manager [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Acquiring lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] No waiting events found dispatching network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:18 user nova-compute[75266]: WARNING nova.compute.manager [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received unexpected event network-vif-plugged-d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance with vm_state active and task_state deleting.
Nov 28 01:01:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Received event network-vif-deleted-d57d7084-7f1f-4e79-9770-0fe51e5f13fc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:19 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Deleted allocations for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d
Nov 28 01:01:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "92237bf8-8ea4-4f79-938d-6dfe03edd31d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received event network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Acquiring lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG nova.compute.manager [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] No waiting events found dispatching network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:19 user nova-compute[75266]: WARNING nova.compute.manager [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received unexpected event network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 for instance with vm_state building and task_state spawning.
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:01:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Instance spawned successfully.
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received event network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Acquiring lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] No waiting events found dispatching network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:21 user nova-compute[75266]: WARNING nova.compute.manager [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received unexpected event network-vif-plugged-9d081e56-9df8-4170-90cc-83bc418127c0 for instance with vm_state building and task_state spawning.
Nov 28 01:01:21 user nova-compute[75266]: INFO nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 28 01:01:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:01:21 user nova-compute[75266]: INFO nova.compute.manager [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Took 6.20 seconds to build instance.
Nov 28 01:01:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:26 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:01:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:01:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8126MB free_disk=25.09003448486328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 55113bea-793b-4d9f-a897-f6f7eb261079 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f0b22014-115e-4871-8dfa-dd14d4c2312e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:01:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:33 user nova-compute[75266]: INFO nova.compute.manager [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Terminating instance
Nov 28 01:01:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-unplugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] No waiting events found dispatching network-vif-unplugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-unplugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:01:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Instance destroyed successfully.
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid 76ee17b8-1169-4f2d-95ff-74eaf625f96f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1208451470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1208451470',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtyUkCqD8pOggg2Myig6/PxeFuXzVrScmiQGk1GNq655YfB3ezMyrTbEbh1XsSEcaMceoI1hkpBeejJxOYffgKCKnxu64nQXQgSVZbspfqDypBUIlH0YUYe3s5Z+oWPcw==',key_name='tempest-keypair-1686178802',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:57:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-7x0jip1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:57:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=76ee17b8-1169-4f2d-95ff-74eaf625f96f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "address": "fa:16:3e:8f:26:ba", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9c5918-85", "ovs_interfaceid": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_vif [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped9c5918-85, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74bb6940-46a3-4e0c-becc-f75b8a285acf) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:34 user nova-compute[75266]: INFO os_vif [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:ba,bridge_name='br-int',has_traffic_filtering=True,id=ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9c5918-85')
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwmnLlJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:01:34 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424f7a5-8209-4330-b52a-7720c5b9098d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:01:34 user nova-compute[75266]: No targets found.
Nov 28 01:01:34 user nova-compute[75266]: iSNS:
Nov 28 01:01:34 user nova-compute[75266]: No targets found.
Nov 28 01:01:34 user nova-compute[75266]: STATIC:
Nov 28 01:01:34 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390
Nov 28 01:01:34 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:34 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:34 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:01:34 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:34 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:34 user nova-compute[75266]: FIRMWARE:
Nov 28 01:01:34 user nova-compute[75266]: No targets found.
Nov 28 01:01:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:01:34 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:01:34 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdee3ff-76a0-40a0-ad36-4ef235a56acb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3953c-bfa1-476b-b613-2d731a8e65a0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:01:34 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 (non-flash)
Nov 28 01:01:34 user nova-compute[75266]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c5ccf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c2427-76ca-480d-b56e-d35920706b6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8434e-beb1-404d-80a3-9c13a0ba096f]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df77cb05-3f39-4b01-a4c1-4e77624d5618]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c5ece6-4590-4dbc-9dad-e7c6ec85e953]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23361656634346366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_97116a95', '/dev/disk/by-id/scsi-1SCST_BIO97116a95-3aef44cf40216dec') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[090709bc-f89e-41a0-a335-58f0d48bd8ae]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d775e8f4-2f1f-4475-8924-635dc750aebe]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee98859-b39f-42a3-869b-ad931f8948d2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260]
Nov 28 01:01:34 user nova-compute[75266]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390, portal: 172.16.0.220,3260] successful.
Nov 28 01:01:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a269223-5c71-46b2-a411-719bb3f3c390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c658ed3-c47e-447c-bc56-9b7f12c1449b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (373ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:01:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Deleting instance files /opt/stack/data/nova/instances/76ee17b8-1169-4f2d-95ff-74eaf625f96f_del
Nov 28 01:01:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Deletion of /opt/stack/data/nova/instances/76ee17b8-1169-4f2d-95ff-74eaf625f96f_del complete
Nov 28 01:01:34 user nova-compute[75266]: INFO nova.compute.manager [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:35 user nova-compute[75266]: INFO nova.compute.manager [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Detaching volume 89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:01:35 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Took 0.99 seconds to deallocate network for instance.
Nov 28 01:01:35 user nova-compute[75266]: INFO nova.virt.block_device [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Attempting to driver detach volume 89fef214-9301-4d77-bb3e-cdfa422e83de from mountpoint /dev/vdb
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Acquiring lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] No waiting events found dispatching network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:01:35 user nova-compute[75266]: WARNING nova.compute.manager [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received unexpected event network-vif-plugged-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance with vm_state active and task_state deleting.
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Received event network-vif-deleted-ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Attempting to detach device vdb from instance f0b22014-115e-4871-8dfa-dd14d4c2312e from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:01:35 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:01:35 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 01:01:35 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:01:35 user nova-compute[75266]:   <serial>89fef214-9301-4d77-bb3e-cdfa422e83de</serial>
Nov 28 01:01:35 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:01:35 user nova-compute[75266]: </disk>
Nov 28 01:01:35 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:01:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance f0b22014-115e-4871-8dfa-dd14d4c2312e from the persistent domain config.
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0b22014-115e-4871-8dfa-dd14d4c2312e from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:01:35 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:01:35 user nova-compute[75266]:   <source dev="/dev/sdi"/>
Nov 28 01:01:35 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:01:35 user nova-compute[75266]:   <serial>89fef214-9301-4d77-bb3e-cdfa422e83de</serial>
Nov 28 01:01:35 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:01:35 user nova-compute[75266]: </disk>
Nov 28 01:01:35 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [{"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-f0b22014-115e-4871-8dfa-dd14d4c2312e" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:01:35 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:01:36 user nova-compute[75266]: INFO nova.compute.manager [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 01:01:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Deleting volume: 6a269223-5c71-46b2-a411-719bb3f3c390 {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:01:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:37 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f
Nov 28 01:01:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "76ee17b8-1169-4f2d-95ff-74eaf625f96f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.845s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:01:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0b22014-115e-4871-8dfa-dd14d4c2312e is timed out.
Nov 28 01:01:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance f0b22014-115e-4871-8dfa-dd14d4c2312e from the live domain config.
Nov 28 01:01:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqotmCFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:01:56 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b654f885-3ef6-4e91-a54b-5ac45dfa7674]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:01:56 user nova-compute[75266]: No targets found.
Nov 28 01:01:56 user nova-compute[75266]: iSNS:
Nov 28 01:01:56 user nova-compute[75266]: No targets found.
Nov 28 01:01:56 user nova-compute[75266]: STATIC:
Nov 28 01:01:56 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de
Nov 28 01:01:56 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:01:56 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:01:56 user nova-compute[75266]: FIRMWARE:
Nov 28 01:01:56 user nova-compute[75266]: No targets found.
Nov 28 01:01:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:01:56 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:01:56 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c78f567-69d6-4888-83f1-d223e916e928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe217c-8eb5-4d8c-8cca-408d819e8d9b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de (non-flash)
Nov 28 01:01:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c33a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de'): ({'sdi'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Removing single pathed devices sdi {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076bda1-57ba-4cbc-beae-1857f99e56d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a7ec08-f2e9-4237-b5ba-8e8b01701a1d]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flushing IO for device /dev/sdi {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd8a66-8bc9-4bce-a56f-3a1257a4c057]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef5cba-49f0-46cf-8c47-2b2f58d8fc05]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] SCSI volumes sdi have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d013b4-def8-4063-8126-190d81ca38b6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21dfdf0-6943-4f07-baed-aad497995801]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260]
Nov 28 01:01:56 user nova-compute[75266]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de, portal: 172.16.0.220,3260] successful.
Nov 28 01:01:56 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fef214-9301-4d77-bb3e-cdfa422e83de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad76c7bb-ee82-4e4b-ac0b-0c101c7065b6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== disconnect_volume: return (265ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:01:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:01:57 user nova-compute[75266]: DEBUG nova.objects.instance [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:01:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.126s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:01:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:02 user nova-compute[75266]: INFO nova.compute.manager [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Unshelving
Nov 28 01:02:02 user nova-compute[75266]: INFO nova.virt.block_device [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Booting with volume 3fa07cbb-69f4-4464-8f9a-a752bde8d39b at /dev/vda
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b92f11-c9ef-46b2-abcd-df9d38a8bc2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b4335-bddf-48d6-9282-b84c120b3bba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14385284-1f81-40ba-83c3-c07e1753fc56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6488a20-86d7-42e4-9c77-c3775101d608]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:02:02 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:02:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aff43d-4897-4463-ac75-f08768f64a2d]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG os_brick.utils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:02:02 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating existing volume attachment record: d99e6eda-e062-4555-afc7-984a771b1a7f {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:02:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:07 user nova-compute[75266]: INFO nova.compute.manager [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Terminating instance
Nov 28 01:02:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Instance destroyed successfully.
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'resources' on Instance uuid 55113bea-793b-4d9f-a897-f6f7eb261079 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-963073311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-963073311',id=3,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576886774b2943b999ec92134d8065b4',ramdisk_id='',reservation_id='r-9datddi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:43:32Z,user_data=None,user_id='8aa0d095400943e28234a9f476ea0a4f',uuid=55113bea-793b-4d9f-a897-f6f7eb261079,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converting VIF {"id": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "address": "fa:16:3e:01:64:6c", "network": {"id": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-263433250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576886774b2943b999ec92134d8065b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178ea9e9-90", "ovs_interfaceid": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG os_vif [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap178ea9e9-90, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60d9cf87-7f7a-40ff-a408-bdd021635347) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: INFO os_vif [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:64:6c,bridge_name='br-int',has_traffic_filtering=True,id=178ea9e9-90f7-4fce-a4eb-a1d90ad483ed,network=Network(0ce73ad0-6ff4-422c-91dd-e52e37370fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178ea9e9-90')
Nov 28 01:02:08 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Deleting instance files /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079_del
Nov 28 01:02:08 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Deletion of /opt/stack/data/nova/instances/55113bea-793b-4d9f-a897-f6f7eb261079_del complete
Nov 28 01:02:08 user nova-compute[75266]: INFO nova.compute.manager [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 28 01:02:08 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:08 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Took 0.53 seconds to deallocate network for instance.
Nov 28 01:02:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-deleted-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:09 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Deleted allocations for instance 55113bea-793b-4d9f-a897-f6f7eb261079
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:02:09 user nova-compute[75266]: INFO nova.compute.claims [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Claim successful on node user
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "55113bea-793b-4d9f-a897-f6f7eb261079" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: INFO nova.network.neutron [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating port 64a1cff7-65f8-4910-82eb-3e8332324c63 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:09 user nova-compute[75266]: WARNING nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state deleted and task_state None.
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:09 user nova-compute[75266]: WARNING nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state deleted and task_state None.
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:09 user nova-compute[75266]: WARNING nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state deleted and task_state None.
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:09 user nova-compute[75266]: WARNING nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-unplugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state deleted and task_state None.
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "55113bea-793b-4d9f-a897-f6f7eb261079-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:09 user nova-compute[75266]: DEBUG nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] No waiting events found dispatching network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:09 user nova-compute[75266]: WARNING nova.compute.manager [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Received unexpected event network-vif-plugged-178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance with vm_state deleted and task_state None.
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing instance network info cache due to event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:02:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Creating image(s)
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start _get_guest_xml network_info=[{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e61e82c-a198-4f76-a2b8-84b3c58be36d', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'serial': '3fa07cbb-69f4-4464-8f9a-a752bde8d39b'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd99e6eda-e062-4555-afc7-984a771b1a7f', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:02:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:10 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.objects.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Object Instance<1e61e82c-a198-4f76-a2b8-84b3c58be36d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:02:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:02:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:02:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:02:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:02:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:02:10 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee726daa-c5cf-499f-b29b-ed43ae302e7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:02:11 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[86153f80-5a3a-42e7-8009-f5712a9e16cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b] added
Nov 28 01:02:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19233b4-7196-4d0d-987e-3714935276bd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3c12c-e2f6-47f0-89d6-8c7781a16f43]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgwNSTOG {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgwNSTOG" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1b2743-7b72-4716-96ee-a1bda898cb67]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UgwNSTOG'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939d2ba-6c70-45b1-af7d-dee9ed2a3991]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2716bcd8-1f39-4d9f-86d7-ec8caa9fe379]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:02:11 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:02:11 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:02:11 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:02:11 user nova-compute[75266]: 
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031c31c-139c-4527-a145-c6a2f0cc4c65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]
Nov 28 01:02:11 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.
Nov 28 01:02:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d18d58a-039a-4ec1-adcb-7fbb61ebbac1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce34d82d-a777-4054-bc9f-803a4a80f67f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a16821-7ade-4f63-ae56-218fe28d1e11]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updated VIF entry in instance network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26565313635646538', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565313635646538', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2097820211',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:02:02Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.objects.base [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Object Instance<1e61e82c-a198-4f76-a2b8-84b3c58be36d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:02:12 user nova-compute[75266]:   <uuid>1e61e82c-a198-4f76-a2b8-84b3c58be36d</uuid>
Nov 28 01:02:12 user nova-compute[75266]:   <name>instance-00000023</name>
Nov 28 01:02:12 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:02:12 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:02:12 user nova-compute[75266]:   <metadata>
Nov 28 01:02:12 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:02:12 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:02:12 user nova-compute[75266]:       <nova:name>tempest-TestShelveInstance-server-2056787703</nova:name>
Nov 28 01:02:12 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:02:10</nova:creationTime>
Nov 28 01:02:12 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:02:12 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:02:12 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:02:12 user nova-compute[75266]:       <nova:owner>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:user uuid="cbce18d8a1ce4e25a7ba0043f40a3a71">tempest-TestShelveInstance-715884180-project-member</nova:user>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:project uuid="42084ccfd4f3455f976a532e4dbf19f7">tempest-TestShelveInstance-715884180</nova:project>
Nov 28 01:02:12 user nova-compute[75266]:       </nova:owner>
Nov 28 01:02:12 user nova-compute[75266]:       <nova:ports>
Nov 28 01:02:12 user nova-compute[75266]:         <nova:port uuid="64a1cff7-65f8-4910-82eb-3e8332324c63">
Nov 28 01:02:12 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 01:02:12 user nova-compute[75266]:         </nova:port>
Nov 28 01:02:12 user nova-compute[75266]:       </nova:ports>
Nov 28 01:02:12 user nova-compute[75266]:     </nova:instance>
Nov 28 01:02:12 user nova-compute[75266]:   </metadata>
Nov 28 01:02:12 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:02:12 user nova-compute[75266]:     <system>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="serial">1e61e82c-a198-4f76-a2b8-84b3c58be36d</entry>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="uuid">1e61e82c-a198-4f76-a2b8-84b3c58be36d</entry>
Nov 28 01:02:12 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:02:12 user nova-compute[75266]:     </system>
Nov 28 01:02:12 user nova-compute[75266]:   </sysinfo>
Nov 28 01:02:12 user nova-compute[75266]:   <os>
Nov 28 01:02:12 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:02:12 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:02:12 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:02:12 user nova-compute[75266]:   </os>
Nov 28 01:02:12 user nova-compute[75266]:   <features>
Nov 28 01:02:12 user nova-compute[75266]:     <acpi/>
Nov 28 01:02:12 user nova-compute[75266]:     <apic/>
Nov 28 01:02:12 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:02:12 user nova-compute[75266]:   </features>
Nov 28 01:02:12 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:02:12 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:02:12 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:02:12 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:02:12 user nova-compute[75266]:   </clock>
Nov 28 01:02:12 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:02:12 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:02:12 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:02:12 user nova-compute[75266]:   </cpu>
Nov 28 01:02:12 user nova-compute[75266]:   <devices>
Nov 28 01:02:12 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:02:12 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:02:12 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 01:02:12 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:02:12 user nova-compute[75266]:       <serial>3fa07cbb-69f4-4464-8f9a-a752bde8d39b</serial>
Nov 28 01:02:12 user nova-compute[75266]:     </disk>
Nov 28 01:02:12 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:02:12 user nova-compute[75266]:       <mac address="fa:16:3e:ae:4c:9f"/>
Nov 28 01:02:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:02:12 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:02:12 user nova-compute[75266]:       <target dev="tap64a1cff7-65"/>
Nov 28 01:02:12 user nova-compute[75266]:     </interface>
Nov 28 01:02:12 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:02:12 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d/console.log" append="off"/>
Nov 28 01:02:12 user nova-compute[75266]:     </serial>
Nov 28 01:02:12 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:02:12 user nova-compute[75266]:     <video>
Nov 28 01:02:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:02:12 user nova-compute[75266]:     </video>
Nov 28 01:02:12 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:02:12 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:02:12 user nova-compute[75266]:     </rng>
Nov 28 01:02:12 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:02:12 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:02:12 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:02:12 user nova-compute[75266]:     </memballoon>
Nov 28 01:02:12 user nova-compute[75266]:   </devices>
Nov 28 01:02:12 user nova-compute[75266]: </domain>
Nov 28 01:02:12 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2097820211',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:02:02Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG os_vif [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58e7c722-3e1a-5e6d-831a-918cea80a8fc', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a1cff7-65, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a1cff7-65, col_values=(('qos', UUID('f48191ec-413e-4784-8921-10be98194055')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a1cff7-65, col_values=(('external_ids', {'iface-id': '64a1cff7-65f8-4910-82eb-3e8332324c63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4c:9f', 'vm-uuid': '1e61e82c-a198-4f76-a2b8-84b3c58be36d'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:12 user nova-compute[75266]: INFO os_vif [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65')
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:02:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] No VIF found with MAC fa:16:3e:ae:4c:9f, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:13 user nova-compute[75266]: WARNING nova.compute.manager [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 01:02:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:02:15 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance spawned successfully.
Nov 28 01:02:15 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.797s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:15 user nova-compute[75266]: WARNING nova.compute.manager [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state active and task_state None.
Nov 28 01:02:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG nova.compute.manager [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing instance network info cache due to event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updated VIF entry in instance network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG nova.network.neutron [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:21 user nova-compute[75266]: INFO nova.compute.manager [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Shelving
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:21 user nova-compute[75266]: WARNING nova.compute.manager [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state active and task_state shelving.
Nov 28 01:02:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:22 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance destroyed successfully.
Nov 28 01:02:22 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Beginning cold snapshot process
Nov 28 01:02:22 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:02:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk /opt/stack/data/nova/instances/snapshots/tmpfx9690_v/766c3afef758408f9e2d475cc21e50b1 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:23 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk /opt/stack/data/nova/instances/snapshots/tmpfx9690_v/766c3afef758408f9e2d475cc21e50b1" returned: 0 in 0.835s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Snapshot extracted, beginning image upload
Nov 28 01:02:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:23 user nova-compute[75266]: DEBUG nova.compute.manager [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:23 user nova-compute[75266]: WARNING nova.compute.manager [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Snapshot image upload complete
Nov 28 01:02:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:02:25 user nova-compute[75266]: INFO nova.compute.manager [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Shelve offloading
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:25 user nova-compute[75266]: INFO nova.compute.manager [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Terminating instance
Nov 28 01:02:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:02:25 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance destroyed successfully.
Nov 28 01:02:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-unplugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] No waiting events found dispatching network-vif-unplugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-unplugged-265df925-6615-406d-8c78-0de24d0d6812 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Instance destroyed successfully.
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'resources' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-960895983',display_name='tempest-AttachVolumeNegativeTest-server-960895983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-960895983',id=33,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeZt2c9UtUtkeVXNTbEsNnGhqm4avOEQ1pdSt7qFI0J5O6ZC6D5QO2RZxaZiPLGAmw7hczfNEUrO1u72wTxnAm0JRO1bulIV8lOW7aQQfrmLSKDWcAsr/0HLEYoQkjksA==',key_name='tempest-keypair-252894268',keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:56:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-ih5vz7q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=f0b22014-115e-4871-8dfa-dd14d4c2312e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "265df925-6615-406d-8c78-0de24d0d6812", "address": "fa:16:3e:a7:aa:44", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap265df925-66", "ovs_interfaceid": "265df925-6615-406d-8c78-0de24d0d6812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG os_vif [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap265df925-66, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46372591-d7ae-4668-acdf-6a55e97bef94) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:26 user nova-compute[75266]: INFO os_vif [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:aa:44,bridge_name='br-int',has_traffic_filtering=True,id=265df925-6615-406d-8c78-0de24d0d6812,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap265df925-66')
Nov 28 01:02:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Deleting instance files /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e_del
Nov 28 01:02:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Deletion of /opt/stack/data/nova/instances/f0b22014-115e-4871-8dfa-dd14d4c2312e_del complete
Nov 28 01:02:26 user nova-compute[75266]: INFO nova.compute.manager [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 01:02:26 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:02:26 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance destroyed successfully.
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'resources' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOoiDu67tR7mPD4Ahv+EVZUaBKP+XiaC7SnbsuKk5Kg2EZdBaWQrDdK48Zxa29VqFkJ235tL35fWdJopN9ifTRlqKpakxgM0g7GrZpLW8OW5tlrTl4wl5Xg24x+8AWTJA==',key_name='tempest-keypair-1399423202',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T01:02:25.822026',shelved_host='user',shelved_image_id='ec30a8ca-42f1-48d5-a917-2bc350a1e95e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG os_vif [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc212acf4-cf, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d785a32-5c65-4b94-aede-53efd3d7e6b8) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:27 user nova-compute[75266]: INFO os_vif [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf')
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Deleting instance files /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703_del
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Deletion of /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703_del complete
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing instance network info cache due to event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Deleted allocations for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'numa_topology' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.objects.base [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<15050b6f-4cc9-45e8-81f0-56ef01c3f703> lazy-loaded attributes: resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.382s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-deleted-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.compute.manager [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Neutron deleted interface 265df925-6615-406d-8c78-0de24d0d6812; detaching it from the instance and deleting it from the info cache
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Detach interface failed, port_id=265df925-6615-406d-8c78-0de24d0d6812, reason: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 01:02:27 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Took 1.13 seconds to deallocate network for instance.
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updated VIF entry in instance network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:02:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc212acf4-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:28 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Deleted allocations for instance f0b22014-115e-4871-8dfa-dd14d4c2312e
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.558s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Acquiring lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Lock "f0b22014-115e-4871-8dfa-dd14d4c2312e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] No waiting events found dispatching network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:28 user nova-compute[75266]: WARNING nova.compute.manager [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Received unexpected event network-vif-plugged-265df925-6615-406d-8c78-0de24d0d6812 for instance with vm_state deleted and task_state None.
Nov 28 01:02:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:29 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:02:29 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:02:30 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:30 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:30 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8376MB free_disk=25.181686401367188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:02:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be77ede0-959e-461b-b138-20828368b597" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:02:34 user nova-compute[75266]: INFO nova.compute.claims [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Claim successful on node user
Nov 28 01:02:34 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:02:34 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:02:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.policy [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:02:35 user nova-compute[75266]: INFO nova.virt.block_device [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Booting with volume 570e5115-038a-4d98-a168-791774596b4e at /dev/vda
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c572f4-fe45-4c83-8a68-ffec84d49e44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c650cf-d9d0-4a1f-8457-685b291db0c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d674f43d-f32c-4f5e-bd8f-99292a00db1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe886ca4-a9bf-44ed-a044-823f0c540d6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:02:35 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116d995-6be4-4ee5-8d65-5d595038434e]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG os_brick.utils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Updating existing volume attachment record: a7bffc7c-6328-4274-bdea-527347f55052 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:02:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Successfully created port: 56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Successfully updated port: 56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-changed-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Refreshing instance network info cache due to event network-changed-56d5d18b-88c0-4129-9c0f-5fdf04fa7714. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Acquiring lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Updating instance_info_cache with network_info: [{"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Instance network_info: |[{"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Acquired lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:02:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Refreshing network info cache for port 56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:02:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:37 user nova-compute[75266]: DEBUG nova.network.neutron [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Updated VIF entry in instance network info cache for port 56d5d18b-88c0-4129-9c0f-5fdf04fa7714. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:02:37 user nova-compute[75266]: DEBUG nova.network.neutron [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Updating instance_info_cache with network_info: [{"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:02:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Releasing lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:02:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:02:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:02:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Creating image(s)
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Ensure instance console log exists: /opt/stack/data/nova/instances/be77ede0-959e-461b-b138-20828368b597/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Start _get_guest_xml network_info=[{"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be77ede0-959e-461b-b138-20828368b597', 'attached_at': '', 'detached_at': '', 'volume_id': '570e5115-038a-4d98-a168-791774596b4e', 'serial': '570e5115-038a-4d98-a168-791774596b4e'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a7bffc7c-6328-4274-bdea-527347f55052', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:02:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:02:42 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:02:42 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:02:42 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569c3a7-7489-44e9-9fa2-ce30b791098f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:02:42 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09ead1-d149-4680-a7dd-ba7537ee5ec2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e] added
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[626bc7ac-bf38-441d-af45-fadd90e6b2be]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dcc046-0bd3-46e5-9c5f-c78e3c649c88]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVWLouDp {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVWLouDp" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e76c7b-dbe2-4519-bf1e-eaf0310972d0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVWLouDp'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd241e22-e0df-4361-9544-aabc9a02d8a9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31effda3-5632-4840-af09-d516110ffe0b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb1ec3-9b29-4436-8d15-76e536bfa81b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]
Nov 28 01:02:42 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[711ebca0-1d12-4646-bccf-21d5dc436a09]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f697a89-7b0a-4381-9ef6-59d706c5d066]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:42 user nova-compute[75266]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:02:42 user nova-compute[75266]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:02:42 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edce2c9-b9e2-427c-b95d-4306a0782948]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:02:42 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23066333966326161', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333966326161', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172133659',display_name='tempest-TestVolumeBootPattern-server-172133659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172133659',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-ubuf53kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:02:35Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be77ede0-959e-461b-b138-20828368b597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.objects.instance [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid be77ede0-959e-461b-b138-20828368b597 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:02:43 user nova-compute[75266]:   <uuid>be77ede0-959e-461b-b138-20828368b597</uuid>
Nov 28 01:02:43 user nova-compute[75266]:   <name>instance-00000029</name>
Nov 28 01:02:43 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:02:43 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:02:43 user nova-compute[75266]:   <metadata>
Nov 28 01:02:43 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:02:43 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:02:43 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-server-172133659</nova:name>
Nov 28 01:02:43 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:02:42</nova:creationTime>
Nov 28 01:02:43 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:02:43 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:02:43 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:02:43 user nova-compute[75266]:       <nova:owner>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 01:02:43 user nova-compute[75266]:       </nova:owner>
Nov 28 01:02:43 user nova-compute[75266]:       <nova:ports>
Nov 28 01:02:43 user nova-compute[75266]:         <nova:port uuid="56d5d18b-88c0-4129-9c0f-5fdf04fa7714">
Nov 28 01:02:43 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 01:02:43 user nova-compute[75266]:         </nova:port>
Nov 28 01:02:43 user nova-compute[75266]:       </nova:ports>
Nov 28 01:02:43 user nova-compute[75266]:     </nova:instance>
Nov 28 01:02:43 user nova-compute[75266]:   </metadata>
Nov 28 01:02:43 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:02:43 user nova-compute[75266]:     <system>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="serial">be77ede0-959e-461b-b138-20828368b597</entry>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="uuid">be77ede0-959e-461b-b138-20828368b597</entry>
Nov 28 01:02:43 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:02:43 user nova-compute[75266]:     </system>
Nov 28 01:02:43 user nova-compute[75266]:   </sysinfo>
Nov 28 01:02:43 user nova-compute[75266]:   <os>
Nov 28 01:02:43 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:02:43 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:02:43 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:02:43 user nova-compute[75266]:   </os>
Nov 28 01:02:43 user nova-compute[75266]:   <features>
Nov 28 01:02:43 user nova-compute[75266]:     <acpi/>
Nov 28 01:02:43 user nova-compute[75266]:     <apic/>
Nov 28 01:02:43 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:02:43 user nova-compute[75266]:   </features>
Nov 28 01:02:43 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:02:43 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:02:43 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:02:43 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:02:43 user nova-compute[75266]:   </clock>
Nov 28 01:02:43 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:02:43 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:02:43 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:02:43 user nova-compute[75266]:   </cpu>
Nov 28 01:02:43 user nova-compute[75266]:   <devices>
Nov 28 01:02:43 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:02:43 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:02:43 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 01:02:43 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:02:43 user nova-compute[75266]:       <serial>570e5115-038a-4d98-a168-791774596b4e</serial>
Nov 28 01:02:43 user nova-compute[75266]:     </disk>
Nov 28 01:02:43 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:02:43 user nova-compute[75266]:       <mac address="fa:16:3e:49:86:31"/>
Nov 28 01:02:43 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:02:43 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:02:43 user nova-compute[75266]:       <target dev="tap56d5d18b-88"/>
Nov 28 01:02:43 user nova-compute[75266]:     </interface>
Nov 28 01:02:43 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:02:43 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/be77ede0-959e-461b-b138-20828368b597/console.log" append="off"/>
Nov 28 01:02:43 user nova-compute[75266]:     </serial>
Nov 28 01:02:43 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:02:43 user nova-compute[75266]:     <video>
Nov 28 01:02:43 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:02:43 user nova-compute[75266]:     </video>
Nov 28 01:02:43 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:02:43 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:02:43 user nova-compute[75266]:     </rng>
Nov 28 01:02:43 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:02:43 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:02:43 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:02:43 user nova-compute[75266]:     </memballoon>
Nov 28 01:02:43 user nova-compute[75266]:   </devices>
Nov 28 01:02:43 user nova-compute[75266]: </domain>
Nov 28 01:02:43 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172133659',display_name='tempest-TestVolumeBootPattern-server-172133659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172133659',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-ubuf53kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:02:35Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be77ede0-959e-461b-b138-20828368b597,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG os_vif [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80fea42a-0806-52a7-b18e-37818b8cd0d3', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d5d18b-88, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d5d18b-88, col_values=(('qos', UUID('760b1264-07c3-4926-9854-3097aea3eb04')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d5d18b-88, col_values=(('external_ids', {'iface-id': '56d5d18b-88c0-4129-9c0f-5fdf04fa7714', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:86:31', 'vm-uuid': 'be77ede0-959e-461b-b138-20828368b597'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:43 user nova-compute[75266]: INFO os_vif [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88')
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:02:43 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:49:86:31, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Acquiring lock "be77ede0-959e-461b-b138-20828368b597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] No waiting events found dispatching network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:45 user nova-compute[75266]: WARNING nova.compute.manager [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received unexpected event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance with vm_state building and task_state spawning.
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:02:47 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: be77ede0-959e-461b-b138-20828368b597] Instance spawned successfully.
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:02:47 user nova-compute[75266]: INFO nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:02:47 user nova-compute[75266]: INFO nova.compute.manager [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Took 12.95 seconds to build instance.
Nov 28 01:02:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.044s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Acquiring lock "be77ede0-959e-461b-b138-20828368b597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:02:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] [instance: be77ede0-959e-461b-b138-20828368b597] No waiting events found dispatching network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:02:47 user nova-compute[75266]: WARNING nova.compute.manager [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received unexpected event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance with vm_state active and task_state None.
Nov 28 01:02:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:02:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:02:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:02:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:02:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:05 user nova-compute[75266]: INFO nova.compute.manager [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Terminating instance
Nov 28 01:03:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Instance destroyed successfully.
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lazy-loading 'resources' on Instance uuid f336a024-e3e9-4ac1-9aad-a7e1d465253f {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-956573247',display_name='tempest-ServersNegativeTestJSON-server-956573247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-956573247',id=40,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-hkg2s98b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:01:22Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=f336a024-e3e9-4ac1-9aad-a7e1d465253f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "9d081e56-9df8-4170-90cc-83bc418127c0", "address": "fa:16:3e:74:40:c4", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d081e56-9d", "ovs_interfaceid": "9d081e56-9df8-4170-90cc-83bc418127c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG os_vif [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d081e56-9d, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c6fa44-f6cd-4ea2-b6cf-a6e2e187ce95) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: INFO os_vif [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:c4,bridge_name='br-int',has_traffic_filtering=True,id=9d081e56-9df8-4170-90cc-83bc418127c0,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d081e56-9d')
Nov 28 01:03:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Deleting instance files /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f_del
Nov 28 01:03:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Deletion of /opt/stack/data/nova/instances/f336a024-e3e9-4ac1-9aad-a7e1d465253f_del complete
Nov 28 01:03:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:06 user nova-compute[75266]: INFO nova.compute.manager [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 28 01:03:06 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:03:06 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Received event network-vif-deleted-9d081e56-9df8-4170-90cc-83bc418127c0 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:07 user nova-compute[75266]: INFO nova.compute.manager [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Neutron deleted interface 9d081e56-9df8-4170-90cc-83bc418127c0; detaching it from the instance and deleting it from the info cache
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.network.neutron [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:07 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Took 0.73 seconds to deallocate network for instance.
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.compute.manager [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Detach interface failed, port_id=9d081e56-9df8-4170-90cc-83bc418127c0, reason: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:07 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Deleted allocations for instance f336a024-e3e9-4ac1-9aad-a7e1d465253f
Nov 28 01:03:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "f336a024-e3e9-4ac1-9aad-a7e1d465253f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:03:10 user nova-compute[75266]: INFO nova.compute.claims [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Claim successful on node user
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:03:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:03:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.policy [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:03:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Creating image(s)
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.190s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk 1073741824" returned: 0 in 0.055s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Successfully created port: ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Cannot resize image /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Ensure instance console log exists: /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Successfully updated port: ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing instance network info cache due to event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance network_info: |[{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.neutron [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start _get_guest_xml network_info=[{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:03:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-630894117',display_name='tempest-ServerStableDeviceRescueTest-server-630894117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-630894117',id=42,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcFw9WNsB/WfF2yeONFBuXL4tVJCd6mCroGfOuvO/4DxlzDl5xxqNI0VkgQOtsTie1dnmO3kC91WgA34H9SFtyuAC+3yOr2ehde8YyilFwrcwTfGsSkIzwL3ui6imEtuQ==',key_name='tempest-keypair-1738700815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc686f7daecb4843b4b0b4f1e89dec89',ramdisk_id='',reservation_id='r-7hyyosdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-109213497',owner_user_name='tempest-ServerStableDeviceRescueTest-109213497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e48c3f1b52e54c41b4499cbc2b767419',uuid=cb931a0c-8094-497e-a63b-676c763d5f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converting VIF {"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'pci_devices' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:03:12 user nova-compute[75266]:   <uuid>cb931a0c-8094-497e-a63b-676c763d5f44</uuid>
Nov 28 01:03:12 user nova-compute[75266]:   <name>instance-0000002a</name>
Nov 28 01:03:12 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:03:12 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:03:12 user nova-compute[75266]:   <metadata>
Nov 28 01:03:12 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:03:12 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-630894117</nova:name>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:03:12</nova:creationTime>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:03:12 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:03:12 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:owner>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:user uuid="e48c3f1b52e54c41b4499cbc2b767419">tempest-ServerStableDeviceRescueTest-109213497-project-member</nova:user>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:project uuid="dc686f7daecb4843b4b0b4f1e89dec89">tempest-ServerStableDeviceRescueTest-109213497</nova:project>
Nov 28 01:03:12 user nova-compute[75266]:       </nova:owner>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:03:12 user nova-compute[75266]:       <nova:ports>
Nov 28 01:03:12 user nova-compute[75266]:         <nova:port uuid="ebf2a135-0f75-4334-9e00-ee1e757402cc">
Nov 28 01:03:12 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 01:03:12 user nova-compute[75266]:         </nova:port>
Nov 28 01:03:12 user nova-compute[75266]:       </nova:ports>
Nov 28 01:03:12 user nova-compute[75266]:     </nova:instance>
Nov 28 01:03:12 user nova-compute[75266]:   </metadata>
Nov 28 01:03:12 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:03:12 user nova-compute[75266]:     <system>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="serial">cb931a0c-8094-497e-a63b-676c763d5f44</entry>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="uuid">cb931a0c-8094-497e-a63b-676c763d5f44</entry>
Nov 28 01:03:12 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:03:12 user nova-compute[75266]:     </system>
Nov 28 01:03:12 user nova-compute[75266]:   </sysinfo>
Nov 28 01:03:12 user nova-compute[75266]:   <os>
Nov 28 01:03:12 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:03:12 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:03:12 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:03:12 user nova-compute[75266]:   </os>
Nov 28 01:03:12 user nova-compute[75266]:   <features>
Nov 28 01:03:12 user nova-compute[75266]:     <acpi/>
Nov 28 01:03:12 user nova-compute[75266]:     <apic/>
Nov 28 01:03:12 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:03:12 user nova-compute[75266]:   </features>
Nov 28 01:03:12 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:03:12 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:03:12 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:03:12 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:03:12 user nova-compute[75266]:   </clock>
Nov 28 01:03:12 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:03:12 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:03:12 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:03:12 user nova-compute[75266]:   </cpu>
Nov 28 01:03:12 user nova-compute[75266]:   <devices>
Nov 28 01:03:12 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:03:12 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:03:12 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk"/>
Nov 28 01:03:12 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:03:12 user nova-compute[75266]:     </disk>
Nov 28 01:03:12 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:03:12 user nova-compute[75266]:       <mac address="fa:16:3e:af:12:7b"/>
Nov 28 01:03:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:03:12 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:03:12 user nova-compute[75266]:       <target dev="tapebf2a135-0f"/>
Nov 28 01:03:12 user nova-compute[75266]:     </interface>
Nov 28 01:03:12 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:03:12 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/console.log" append="off"/>
Nov 28 01:03:12 user nova-compute[75266]:     </serial>
Nov 28 01:03:12 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:03:12 user nova-compute[75266]:     <video>
Nov 28 01:03:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:03:12 user nova-compute[75266]:     </video>
Nov 28 01:03:12 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:03:12 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:03:12 user nova-compute[75266]:     </rng>
Nov 28 01:03:12 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:03:12 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:03:12 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:03:12 user nova-compute[75266]:     </memballoon>
Nov 28 01:03:12 user nova-compute[75266]:   </devices>
Nov 28 01:03:12 user nova-compute[75266]: </domain>
Nov 28 01:03:12 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-630894117',display_name='tempest-ServerStableDeviceRescueTest-server-630894117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-630894117',id=42,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcFw9WNsB/WfF2yeONFBuXL4tVJCd6mCroGfOuvO/4DxlzDl5xxqNI0VkgQOtsTie1dnmO3kC91WgA34H9SFtyuAC+3yOr2ehde8YyilFwrcwTfGsSkIzwL3ui6imEtuQ==',key_name='tempest-keypair-1738700815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc686f7daecb4843b4b0b4f1e89dec89',ramdisk_id='',reservation_id='r-7hyyosdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-109213497',owner_user_name='tempest-ServerStableDeviceRescueTest-109213497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e48c3f1b52e54c41b4499cbc2b767419',uuid=cb931a0c-8094-497e-a63b-676c763d5f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converting VIF {"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG os_vif [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52fdbe8e-4c57-50a8-90a5-d436250e9fff', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf2a135-0f, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebf2a135-0f, col_values=(('qos', UUID('86657034-8ce6-4d06-b88f-b87011afb891')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebf2a135-0f, col_values=(('external_ids', {'iface-id': 'ebf2a135-0f75-4334-9e00-ee1e757402cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:12:7b', 'vm-uuid': 'cb931a0c-8094-497e-a63b-676c763d5f44'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:12 user nova-compute[75266]: INFO os_vif [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f')
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:03:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No VIF found with MAC fa:16:3e:af:12:7b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:03:13 user nova-compute[75266]: DEBUG nova.network.neutron [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated VIF entry in instance network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:03:13 user nova-compute[75266]: DEBUG nova.network.neutron [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:14 user nova-compute[75266]: WARNING nova.compute.manager [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state building and task_state spawning.
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:03:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance spawned successfully.
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:16 user nova-compute[75266]: INFO nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:16 user nova-compute[75266]: INFO nova.compute.manager [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Took 5.96 seconds to build instance.
Nov 28 01:03:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.054s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:16 user nova-compute[75266]: WARNING nova.compute.manager [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state active and task_state None.
Nov 28 01:03:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:03:20 user nova-compute[75266]: INFO nova.compute.claims [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Claim successful on node user
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:03:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.policy [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:03:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Creating image(s)
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.272s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk 1073741824" returned: 0 in 0.073s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Successfully created port: c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Cannot resize image /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Ensure instance console log exists: /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Successfully updated port: c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquired lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-changed-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Refreshing instance network info cache due to event network-changed-c54006a4-4d8f-444d-897a-419008313a91. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Acquiring lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating instance_info_cache with network_info: [{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Releasing lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Instance network_info: |[{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Acquired lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Refreshing network info cache for port c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Start _get_guest_xml network_info=[{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:03:22 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:22 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1303619575',display_name='tempest-AttachVolumeNegativeTest-server-1303619575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1303619575',id=43,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwyioFYYrzy8F+NUX5Ky5kFXporVF3GEo/6CywbWGUbIrn89eveMlhxaNDiTAuA4nTc6D7rl47f1VM0u2KrFNTDEZxG2jtNvGvJ9opo8Kgq4UkoMxsZsWx3u3NVjKHyA==',key_name='tempest-keypair-1774369941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-9ykp3mwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=a4968288-fce2-45df-8ec1-9fc8b7db41cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'pci_devices' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:03:22 user nova-compute[75266]:   <uuid>a4968288-fce2-45df-8ec1-9fc8b7db41cc</uuid>
Nov 28 01:03:22 user nova-compute[75266]:   <name>instance-0000002b</name>
Nov 28 01:03:22 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:03:22 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:03:22 user nova-compute[75266]:   <metadata>
Nov 28 01:03:22 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:03:22 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1303619575</nova:name>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:03:22</nova:creationTime>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:03:22 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:03:22 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:owner>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:user uuid="6692115b7e8042c38fb8ecb84a5af250">tempest-AttachVolumeNegativeTest-471615281-project-member</nova:user>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:project uuid="45ead1a8b36544df9a2bf0feb223ba62">tempest-AttachVolumeNegativeTest-471615281</nova:project>
Nov 28 01:03:22 user nova-compute[75266]:       </nova:owner>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:03:22 user nova-compute[75266]:       <nova:ports>
Nov 28 01:03:22 user nova-compute[75266]:         <nova:port uuid="c54006a4-4d8f-444d-897a-419008313a91">
Nov 28 01:03:22 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 01:03:22 user nova-compute[75266]:         </nova:port>
Nov 28 01:03:22 user nova-compute[75266]:       </nova:ports>
Nov 28 01:03:22 user nova-compute[75266]:     </nova:instance>
Nov 28 01:03:22 user nova-compute[75266]:   </metadata>
Nov 28 01:03:22 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:03:22 user nova-compute[75266]:     <system>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="serial">a4968288-fce2-45df-8ec1-9fc8b7db41cc</entry>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="uuid">a4968288-fce2-45df-8ec1-9fc8b7db41cc</entry>
Nov 28 01:03:22 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:03:22 user nova-compute[75266]:     </system>
Nov 28 01:03:22 user nova-compute[75266]:   </sysinfo>
Nov 28 01:03:22 user nova-compute[75266]:   <os>
Nov 28 01:03:22 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:03:22 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:03:22 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:03:22 user nova-compute[75266]:   </os>
Nov 28 01:03:22 user nova-compute[75266]:   <features>
Nov 28 01:03:22 user nova-compute[75266]:     <acpi/>
Nov 28 01:03:22 user nova-compute[75266]:     <apic/>
Nov 28 01:03:22 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:03:22 user nova-compute[75266]:   </features>
Nov 28 01:03:22 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:03:22 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:03:22 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:03:22 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:03:22 user nova-compute[75266]:   </clock>
Nov 28 01:03:22 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:03:22 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:03:22 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:03:22 user nova-compute[75266]:   </cpu>
Nov 28 01:03:22 user nova-compute[75266]:   <devices>
Nov 28 01:03:22 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:03:22 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:03:22 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk"/>
Nov 28 01:03:22 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:03:22 user nova-compute[75266]:     </disk>
Nov 28 01:03:22 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:03:22 user nova-compute[75266]:       <mac address="fa:16:3e:49:54:0b"/>
Nov 28 01:03:22 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:03:22 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:03:22 user nova-compute[75266]:       <target dev="tapc54006a4-4d"/>
Nov 28 01:03:22 user nova-compute[75266]:     </interface>
Nov 28 01:03:22 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:03:22 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/console.log" append="off"/>
Nov 28 01:03:22 user nova-compute[75266]:     </serial>
Nov 28 01:03:22 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:03:22 user nova-compute[75266]:     <video>
Nov 28 01:03:22 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:03:22 user nova-compute[75266]:     </video>
Nov 28 01:03:22 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:03:22 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:03:22 user nova-compute[75266]:     </rng>
Nov 28 01:03:22 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:03:22 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:03:22 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:03:22 user nova-compute[75266]:     </memballoon>
Nov 28 01:03:22 user nova-compute[75266]:   </devices>
Nov 28 01:03:22 user nova-compute[75266]: </domain>
Nov 28 01:03:22 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1303619575',display_name='tempest-AttachVolumeNegativeTest-server-1303619575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1303619575',id=43,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwyioFYYrzy8F+NUX5Ky5kFXporVF3GEo/6CywbWGUbIrn89eveMlhxaNDiTAuA4nTc6D7rl47f1VM0u2KrFNTDEZxG2jtNvGvJ9opo8Kgq4UkoMxsZsWx3u3NVjKHyA==',key_name='tempest-keypair-1774369941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-9ykp3mwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=a4968288-fce2-45df-8ec1-9fc8b7db41cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG os_vif [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21b16747-f121-51d7-a916-59e8046888eb', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc54006a4-4d, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc54006a4-4d, col_values=(('qos', UUID('3985e212-d762-475f-baa9-107465ee2a19')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc54006a4-4d, col_values=(('external_ids', {'iface-id': 'c54006a4-4d8f-444d-897a-419008313a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:54:0b', 'vm-uuid': 'a4968288-fce2-45df-8ec1-9fc8b7db41cc'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:22 user nova-compute[75266]: INFO os_vif [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d')
Nov 28 01:03:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:03:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:49:54:0b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:03:23 user nova-compute[75266]: DEBUG nova.network.neutron [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updated VIF entry in instance network info cache for port c54006a4-4d8f-444d-897a-419008313a91. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:03:23 user nova-compute[75266]: DEBUG nova.network.neutron [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating instance_info_cache with network_info: [{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Releasing lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] No waiting events found dispatching network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:24 user nova-compute[75266]: WARNING nova.compute.manager [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received unexpected event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 for instance with vm_state building and task_state spawning.
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] No waiting events found dispatching network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:26 user nova-compute[75266]: WARNING nova.compute.manager [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received unexpected event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 for instance with vm_state building and task_state spawning.
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:03:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Instance spawned successfully.
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:03:26 user nova-compute[75266]: INFO nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 28 01:03:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:03:26 user nova-compute[75266]: INFO nova.compute.manager [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Took 6.48 seconds to build instance.
Nov 28 01:03:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:03:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:32 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8271MB free_disk=25.176795959472656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be77ede0-959e-461b-b138-20828368b597 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:03:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:03:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid b375c38b-e368-4e2a-b988-0ae27130a878 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:03:36 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updating instance_info_cache with network_info: [{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:03:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:03:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing instance network info cache due to event network-changed-64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Acquiring lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Acquired lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG nova.network.neutron [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Refreshing network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:53 user nova-compute[75266]: INFO nova.compute.manager [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Terminating instance
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-unplugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updated VIF entry in instance network info cache for port 64a1cff7-65f8-4910-82eb-3e8332324c63. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.network.neutron [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [{"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Releasing lock "refresh_cache-1e61e82c-a198-4f76-a2b8-84b3c58be36d" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:03:53 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Instance destroyed successfully.
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'resources' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T00:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2056787703',display_name='tempest-TestShelveInstance-server-2056787703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2056787703',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KNQqJEkWGmzZifPUVaLA75cWARw0qE/b2TEuxTimAKA+NMfhXs8WJnpbDfmPzdEvNU0XTfO37MxPtD+1IFavGk4iz1iq94AyP1MZC1OnuSEjEHHqIHb9E/bv4urgRBw==',key_name='tempest-TestShelveInstance-2097820211',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:02:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42084ccfd4f3455f976a532e4dbf19f7',ramdisk_id='',reservation_id='r-oxseywp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-715884180',owner_user_name='tempest-TestShelveInstance-715884180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:02:16Z,user_data=None,user_id='cbce18d8a1ce4e25a7ba0043f40a3a71',uuid=1e61e82c-a198-4f76-a2b8-84b3c58be36d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converting VIF {"id": "64a1cff7-65f8-4910-82eb-3e8332324c63", "address": "fa:16:3e:ae:4c:9f", "network": {"id": "30e73ff5-31d7-4a4c-a96a-32e79774110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1730448902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42084ccfd4f3455f976a532e4dbf19f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a1cff7-65", "ovs_interfaceid": "64a1cff7-65f8-4910-82eb-3e8332324c63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_vif [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a1cff7-65, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f48191ec-413e-4784-8921-10be98194055) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:53 user nova-compute[75266]: INFO os_vif [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4c:9f,bridge_name='br-int',has_traffic_filtering=True,id=64a1cff7-65f8-4910-82eb-3e8332324c63,network=Network(30e73ff5-31d7-4a4c-a96a-32e79774110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a1cff7-65')
Nov 28 01:03:53 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgwNSTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:03:53 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6558a012-6fb2-45e7-acf8-f7e5586ab608]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:03:53 user nova-compute[75266]: No targets found.
Nov 28 01:03:53 user nova-compute[75266]: iSNS:
Nov 28 01:03:53 user nova-compute[75266]: No targets found.
Nov 28 01:03:53 user nova-compute[75266]: STATIC:
Nov 28 01:03:53 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:03:53 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:03:53 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:03:53 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b
Nov 28 01:03:53 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:03:53 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:03:53 user nova-compute[75266]: FIRMWARE:
Nov 28 01:03:53 user nova-compute[75266]: No targets found.
Nov 28 01:03:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:03:53 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:03:53 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a518f-bdde-4c4a-85ba-13e82ea84b50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102dc6b-3915-4bff-8d6a-715aa2b083bb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:03:53 user nova-compute[75266]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:03:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b (non-flash)
Nov 28 01:03:53 user nova-compute[75266]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:03:53 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bac124c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6803487-9140-4dfc-ab6e-f83374043367]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee7ea1-09ab-4303-a388-b2d7bb4f5a08]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20d81a-1f93-40d8-9d3f-5f1d058635aa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:03:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a831d-a95b-449f-98a4-5b6b0a88903a]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7f907f51-ee165de860489415', '/dev/disk/by-id/scsi-26565313635646538', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7f907f51') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7644fe-d800-44d1-af89-fcf5c33a68e2]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e2eea-5256-489a-8a00-112cce8dca39]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf1ff06-78d7-4408-97ac-0232808263cb]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260]
Nov 28 01:03:54 user nova-compute[75266]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b, portal: 172.16.0.220,3260] successful.
Nov 28 01:03:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa07cbb-69f4-4464-8f9a-a752bde8d39b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81866682-f859-4332-981c-6a5ef9ba18c2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] <== disconnect_volume: return (308ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:03:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deleting instance files /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d_del
Nov 28 01:03:54 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deletion of /opt/stack/data/nova/instances/1e61e82c-a198-4f76-a2b8-84b3c58be36d_del complete
Nov 28 01:03:54 user nova-compute[75266]: INFO nova.compute.manager [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 28 01:03:54 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:03:54 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:03:54 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Took 0.40 seconds to deallocate network for instance.
Nov 28 01:03:54 user nova-compute[75266]: DEBUG nova.compute.manager [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-deleted-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Acquiring lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] No waiting events found dispatching network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:03:55 user nova-compute[75266]: WARNING nova.compute.manager [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Received unexpected event network-vif-plugged-64a1cff7-65f8-4910-82eb-3e8332324c63 for instance with vm_state active and task_state deleting.
Nov 28 01:03:55 user nova-compute[75266]: INFO nova.compute.manager [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Took 0.76 seconds to detach 1 volumes for instance.
Nov 28 01:03:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Deleting volume: 3fa07cbb-69f4-4464-8f9a-a752bde8d39b {{(pid=75266) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:55 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Deleted allocations for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d
Nov 28 01:03:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "1e61e82c-a198-4f76-a2b8-84b3c58be36d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:03:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:03:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:04:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:13 user nova-compute[75266]: INFO nova.compute.manager [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Unshelving
Nov 28 01:04:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_requests' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'numa_topology' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:13 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:04:13 user nova-compute[75266]: INFO nova.compute.claims [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Claim successful on node user
Nov 28 01:04:14 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:04:14 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:04:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:14 user nova-compute[75266]: INFO nova.network.neutron [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating port c212acf4-cf66-4cc0-8038-45ad6868166b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.compute.manager [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing instance network info cache due to event network-changed-c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Acquiring lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.network.neutron [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:04:15 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Creating image(s)
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Acquired lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.network.neutron [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Refreshing network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG nova.objects.base [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<15050b6f-4cc9-45e8-81f0-56ef01c3f703> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG nova.virt.images [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] ec30a8ca-42f1-48d5-a917-2bc350a1e95e was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.part /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG nova.network.neutron [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updated VIF entry in instance network info cache for port c212acf4-cf66-4cc0-8038-45ad6868166b. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG nova.network.neutron [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:04:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Releasing lock "refresh_cache-15050b6f-4cc9-45e8-81f0-56ef01c3f703" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.part /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.converted" returned: 0 in 0.493s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.842s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162,backing_fmt=raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162,backing_fmt=raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk 1073741824" returned: 0 in 0.054s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "76f54b9a5402b8fe11e384a959e6a9f25c619162" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:17 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162 --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'migration_context' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG nova.objects.base [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<15050b6f-4cc9-45e8-81f0-56ef01c3f703> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:04:18 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Rebasing disk image.
Nov 28 01:04:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 -F raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 -F raw /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk" returned: 0 in 1.942s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Ensure instance console log exists: /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start _get_guest_xml network_info=[{"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aacfdeee9dd47fe1c3bfc5b7fc241bc3',container_format='bare',created_at=2023-11-28T01:02:21Z,direct_url=<?>,disk_format='qcow2',id=ec30a8ca-42f1-48d5-a917-2bc350a1e95e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-229525217-shelved',owner='52c236f1599d4a4fb181b4aa73058211',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T01:02:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:04:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:04:20 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aacfdeee9dd47fe1c3bfc5b7fc241bc3',container_format='bare',created_at=2023-11-28T01:02:21Z,direct_url=<?>,disk_format='qcow2',id=ec30a8ca-42f1-48d5-a917-2bc350a1e95e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-229525217-shelved',owner='52c236f1599d4a4fb181b4aa73058211',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T01:02:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<15050b6f-4cc9-45e8-81f0-56ef01c3f703> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='ec30a8ca-42f1-48d5-a917-2bc350a1e95e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1399423202',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T01:02:25.822026',shelved_host='user',shelved_image_id='ec30a8ca-42f1-48d5-a917-2bc350a1e95e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'pci_devices' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.objects.base [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Object Instance<15050b6f-4cc9-45e8-81f0-56ef01c3f703> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:04:20 user nova-compute[75266]:   <uuid>15050b6f-4cc9-45e8-81f0-56ef01c3f703</uuid>
Nov 28 01:04:20 user nova-compute[75266]:   <name>instance-00000027</name>
Nov 28 01:04:20 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:04:20 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:04:20 user nova-compute[75266]:   <metadata>
Nov 28 01:04:20 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:04:20 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-229525217</nova:name>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:04:20</nova:creationTime>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:04:20 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:04:20 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:owner>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:user uuid="1fd50f4f867e4efcad9e16d45dde6df0">tempest-AttachVolumeShelveTestJSON-107867446-project-member</nova:user>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:project uuid="52c236f1599d4a4fb181b4aa73058211">tempest-AttachVolumeShelveTestJSON-107867446</nova:project>
Nov 28 01:04:20 user nova-compute[75266]:       </nova:owner>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:root type="image" uuid="ec30a8ca-42f1-48d5-a917-2bc350a1e95e"/>
Nov 28 01:04:20 user nova-compute[75266]:       <nova:ports>
Nov 28 01:04:20 user nova-compute[75266]:         <nova:port uuid="c212acf4-cf66-4cc0-8038-45ad6868166b">
Nov 28 01:04:20 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 01:04:20 user nova-compute[75266]:         </nova:port>
Nov 28 01:04:20 user nova-compute[75266]:       </nova:ports>
Nov 28 01:04:20 user nova-compute[75266]:     </nova:instance>
Nov 28 01:04:20 user nova-compute[75266]:   </metadata>
Nov 28 01:04:20 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:04:20 user nova-compute[75266]:     <system>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="serial">15050b6f-4cc9-45e8-81f0-56ef01c3f703</entry>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="uuid">15050b6f-4cc9-45e8-81f0-56ef01c3f703</entry>
Nov 28 01:04:20 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:04:20 user nova-compute[75266]:     </system>
Nov 28 01:04:20 user nova-compute[75266]:   </sysinfo>
Nov 28 01:04:20 user nova-compute[75266]:   <os>
Nov 28 01:04:20 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:04:20 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:04:20 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:04:20 user nova-compute[75266]:   </os>
Nov 28 01:04:20 user nova-compute[75266]:   <features>
Nov 28 01:04:20 user nova-compute[75266]:     <acpi/>
Nov 28 01:04:20 user nova-compute[75266]:     <apic/>
Nov 28 01:04:20 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:04:20 user nova-compute[75266]:   </features>
Nov 28 01:04:20 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:04:20 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:04:20 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:04:20 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:04:20 user nova-compute[75266]:   </clock>
Nov 28 01:04:20 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:04:20 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:04:20 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:04:20 user nova-compute[75266]:   </cpu>
Nov 28 01:04:20 user nova-compute[75266]:   <devices>
Nov 28 01:04:20 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:04:20 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:04:20 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk"/>
Nov 28 01:04:20 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:04:20 user nova-compute[75266]:     </disk>
Nov 28 01:04:20 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:04:20 user nova-compute[75266]:       <mac address="fa:16:3e:53:17:ac"/>
Nov 28 01:04:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:04:20 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:04:20 user nova-compute[75266]:       <target dev="tapc212acf4-cf"/>
Nov 28 01:04:20 user nova-compute[75266]:     </interface>
Nov 28 01:04:20 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:04:20 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/console.log" append="off"/>
Nov 28 01:04:20 user nova-compute[75266]:     </serial>
Nov 28 01:04:20 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:04:20 user nova-compute[75266]:     <video>
Nov 28 01:04:20 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:04:20 user nova-compute[75266]:     </video>
Nov 28 01:04:20 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:04:20 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:04:20 user nova-compute[75266]:     </rng>
Nov 28 01:04:20 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:04:20 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:04:20 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:04:20 user nova-compute[75266]:     </memballoon>
Nov 28 01:04:20 user nova-compute[75266]:   </devices>
Nov 28 01:04:20 user nova-compute[75266]: </domain>
Nov 28 01:04:20 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='ec30a8ca-42f1-48d5-a917-2bc350a1e95e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1399423202',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member',shelved_at='2023-11-28T01:02:25.822026',shelved_host='user',shelved_image_id='ec30a8ca-42f1-48d5-a917-2bc350a1e95e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG os_vif [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4470fff1-f138-5045-8e54-2711ad8a4e3e', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc212acf4-cf, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc212acf4-cf, col_values=(('qos', UUID('be8a9a84-0be3-40ff-a219-0086e3f96283')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc212acf4-cf, col_values=(('external_ids', {'iface-id': 'c212acf4-cf66-4cc0-8038-45ad6868166b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:17:ac', 'vm-uuid': '15050b6f-4cc9-45e8-81f0-56ef01c3f703'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:20 user nova-compute[75266]: INFO os_vif [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf')
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:04:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] No VIF found with MAC fa:16:3e:53:17:ac, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:04:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:04:22 user nova-compute[75266]: WARNING nova.compute.manager [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 01:04:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:04:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance spawned successfully.
Nov 28 01:04:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG nova.compute.manager [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:04:24 user nova-compute[75266]: WARNING nova.compute.manager [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 01:04:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:04:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.672s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-changed-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG nova.compute.manager [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Refreshing instance network info cache due to event network-changed-56d5d18b-88c0-4129-9c0f-5fdf04fa7714. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Acquiring lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Acquired lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:04:26 user nova-compute[75266]: DEBUG nova.network.neutron [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Refreshing network info cache for port 56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Updated VIF entry in instance network info cache for port 56d5d18b-88c0-4129-9c0f-5fdf04fa7714. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG nova.network.neutron [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Updating instance_info_cache with network_info: [{"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Releasing lock "refresh_cache-be77ede0-959e-461b-b138-20828368b597" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be77ede0-959e-461b-b138-20828368b597" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be77ede0-959e-461b-b138-20828368b597-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:27 user nova-compute[75266]: INFO nova.compute.manager [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Terminating instance
Nov 28 01:04:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:28 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: be77ede0-959e-461b-b138-20828368b597] Instance destroyed successfully.
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.objects.instance [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid be77ede0-959e-461b-b138-20828368b597 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172133659',display_name='tempest-TestVolumeBootPattern-server-172133659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172133659',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-ubuf53kw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:02:48Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be77ede0-959e-461b-b138-20828368b597,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "address": "fa:16:3e:49:86:31", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d5d18b-88", "ovs_interfaceid": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_vif [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d5d18b-88, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=760b1264-07c3-4926-9854-3097aea3eb04) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:28 user nova-compute[75266]: INFO os_vif [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:86:31,bridge_name='br-int',has_traffic_filtering=True,id=56d5d18b-88c0-4129-9c0f-5fdf04fa7714,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d5d18b-88')
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:04:28 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b7791-d5e6-4b25-898b-3ff67ddec9ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:04:28 user nova-compute[75266]: No targets found.
Nov 28 01:04:28 user nova-compute[75266]: iSNS:
Nov 28 01:04:28 user nova-compute[75266]: No targets found.
Nov 28 01:04:28 user nova-compute[75266]: STATIC:
Nov 28 01:04:28 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:04:28 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:04:28 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:04:28 user nova-compute[75266]: FIRMWARE:
Nov 28 01:04:28 user nova-compute[75266]: No targets found.
Nov 28 01:04:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:04:28 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:04:28 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac873e-4373-4bc7-af97-f027e16e2166]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b9114a-dab7-4dd3-9071-6ebe79f70230]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:04:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:04:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c3b72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac815368-7202-4b9b-ba37-9de132dbbe95]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d60afc-3a34-4bcd-9a7d-0d27b997c986]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e18d7-c932-4264-85ce-f2fb7e365610]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1aca4e-499e-4e7e-9ba1-9ca7247fc88e]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ba7f947-0f39f2aab6236c9f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ba7f947', '/dev/disk/by-id/scsi-23066333966326161') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81857d-9425-4870-993c-4bbf950e03bc]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e084154-cfbc-439e-928e-9d51887af984]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec269388-bef1-490c-a2fb-0195c486fb98]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]
Nov 28 01:04:28 user nova-compute[75266]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.
Nov 28 01:04:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd01ad-1857-49c9-a9b9-56e426cab573]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (363ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:04:28 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Deleting instance files /opt/stack/data/nova/instances/be77ede0-959e-461b-b138-20828368b597_del
Nov 28 01:04:28 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Deletion of /opt/stack/data/nova/instances/be77ede0-959e-461b-b138-20828368b597_del complete
Nov 28 01:04:28 user nova-compute[75266]: INFO nova.compute.manager [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: be77ede0-959e-461b-b138-20828368b597] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: be77ede0-959e-461b-b138-20828368b597] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-unplugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Acquiring lock "be77ede0-959e-461b-b138-20828368b597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] No waiting events found dispatching network-vif-unplugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-unplugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Acquiring lock "be77ede0-959e-461b-b138-20828368b597-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "be77ede0-959e-461b-b138-20828368b597-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:28 user nova-compute[75266]: DEBUG nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] No waiting events found dispatching network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:04:28 user nova-compute[75266]: WARNING nova.compute.manager [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received unexpected event network-vif-plugged-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance with vm_state active and task_state deleting.
Nov 28 01:04:29 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: be77ede0-959e-461b-b138-20828368b597] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:04:29 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: be77ede0-959e-461b-b138-20828368b597] Took 0.92 seconds to deallocate network for instance.
Nov 28 01:04:29 user nova-compute[75266]: DEBUG nova.compute.manager [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] [instance: be77ede0-959e-461b-b138-20828368b597] Received event network-vif-deleted-56d5d18b-88c0-4129-9c0f-5fdf04fa7714 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:04:30 user nova-compute[75266]: INFO nova.compute.manager [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 01:04:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:30 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:04:30 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:04:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:30 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance be77ede0-959e-461b-b138-20828368b597
Nov 28 01:04:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be77ede0-959e-461b-b138-20828368b597" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:04:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:04:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=25.112777709960938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:04:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:04:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:36 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:04:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:04:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:04:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:04:37 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:04:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:04:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:04:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:04:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:04:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:04:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:04:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing instance network info cache due to event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated VIF entry in instance network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:05:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:05:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:05:02 user nova-compute[75266]: INFO nova.compute.manager [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] instance snapshotting
Nov 28 01:05:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Beginning live snapshot process
Nov 28 01:05:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json -f qcow2 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.204s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f.delta 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f.delta 1073741824" returned: 0 in 0.053s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 01:05:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 01:05:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75266) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 01:05:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 01:05:04 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:05:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f.delta /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f.delta /opt/stack/data/nova/instances/snapshots/tmpoi6qd0_7/b9593d564b0e400aa64eb4a3c110c75f" returned: 0 in 0.505s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:05 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Snapshot extracted, beginning image upload
Nov 28 01:05:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:07 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Snapshot image upload complete
Nov 28 01:05:07 user nova-compute[75266]: INFO nova.compute.manager [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Took 5.14 seconds to snapshot the instance on the hypervisor.
Nov 28 01:05:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-changed-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:05:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Refreshing instance network info cache due to event network-changed-c54006a4-4d8f-444d-897a-419008313a91. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:05:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Acquiring lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:05:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Acquired lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:05:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Refreshing network info cache for port c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:05:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updated VIF entry in instance network info cache for port c54006a4-4d8f-444d-897a-419008313a91. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:05:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating instance_info_cache with network_info: [{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:05:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Releasing lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:05:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:13 user nova-compute[75266]: INFO nova.compute.manager [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Attaching volume f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 to /dev/vdb
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.utils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b722d06-ec41-4fdc-8573-80b570cd3106]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d6826-5b9d-452f-aca6-03d1f15ee711]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81367dc-2793-48d0-8022-4ca1046114e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b620c-7c4d-4146-bef1-18a6df946ff6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:05:13 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:05:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e778db-b115-4c88-a273-cccbbb19d5a0]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG os_brick.utils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:05:13 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating existing volume attachment record: 405c4994-fd85-468f-be98-1bd2ec89b579 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:05:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:05:19 user nova-compute[75266]: INFO nova.compute.claims [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Claim successful on node user
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:05:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.policy [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:05:19 user nova-compute[75266]: INFO nova.virt.block_device [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Booting with volume 570e5115-038a-4d98-a168-791774596b4e at /dev/vda
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.utils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[623fee0b-4598-443b-b8f0-95046c992f48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2c7264-c5b7-4810-bc0e-2a503904562b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1f560-e3f8-4d12-b026-0405146d7988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5085f2-e8de-4e32-82f5-3f50522a22e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:05:19 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:05:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed009f6f-081b-4d96-b569-912f5980c86a]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG os_brick.utils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:05:19 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating existing volume attachment record: 91c123c8-d977-4599-b840-aae5dd27261e {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Successfully created port: c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENapXCDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:05:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:05:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:05:20 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b0b72f-506a-4695-94a3-7e56303abf85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:05:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37c6fe1-611f-422a-adb0-f1010d179cc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2] added
Nov 28 01:05:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060bee2-57c6-4e92-bbea-25cc9f10d607]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e9fb2-ea09-4b81-8dd7-352a65ee4bc3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENapXCDr {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENapXCDr" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[44725753-e2a9-4184-a7df-1da7bb6bd08e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ENapXCDr'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9936e-c6af-4a2b-9ae6-6b9a5399f220]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73006d2a-f483-486e-af3c-91d261efae4b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:05:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:05:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:05:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:05:20 user nova-compute[75266]: 
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[514be638-c1f5-4612-8432-20409cc530dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260]
Nov 28 01:05:20 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260] successful.
Nov 28 01:05:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc685782-1d40-4ae9-af1b-53da474d3fe6]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[44abda29-5f7b-4b6a-8f08-a04026f446d8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6953065-a5f1-49d4-abc0-e6ae7dd8ab82]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Successfully updated port: c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing instance network info cache due to event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:05:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Acquiring lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Instance network_info: |[{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Acquired lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updated VIF entry in instance network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Releasing lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENapXCDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23938613134326637', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938613134326637', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:05:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:05:21 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:05:21 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:05:21 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:05:21 user nova-compute[75266]:   <serial>f0dad8bc-bbd0-44e7-a817-7b1267b10aa2</serial>
Nov 28 01:05:21 user nova-compute[75266]: </disk>
Nov 28 01:05:21 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:05:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:05:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:05:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:49:54:0b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:05:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.796s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:23 user nova-compute[75266]: INFO nova.compute.manager [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Detaching volume f0dad8bc-bbd0-44e7-a817-7b1267b10aa2
Nov 28 01:05:23 user nova-compute[75266]: INFO nova.virt.block_device [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Attempting to driver detach volume f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 from mountpoint /dev/vdb
Nov 28 01:05:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Attempting to detach device vdb from instance a4968288-fce2-45df-8ec1-9fc8b7db41cc from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:05:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:05:23 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:05:23 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:05:23 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:05:23 user nova-compute[75266]:   <serial>f0dad8bc-bbd0-44e7-a817-7b1267b10aa2</serial>
Nov 28 01:05:23 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:05:23 user nova-compute[75266]: </disk>
Nov 28 01:05:23 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:05:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance a4968288-fce2-45df-8ec1-9fc8b7db41cc from the persistent domain config.
Nov 28 01:05:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4968288-fce2-45df-8ec1-9fc8b7db41cc from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:05:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:05:23 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:05:23 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:05:23 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:05:23 user nova-compute[75266]:   <serial>f0dad8bc-bbd0-44e7-a817-7b1267b10aa2</serial>
Nov 28 01:05:23 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:05:23 user nova-compute[75266]: </disk>
Nov 28 01:05:23 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:05:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:05:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Creating image(s)
Nov 28 01:05:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Ensure instance console log exists: /opt/stack/data/nova/instances/be9ab357-37c6-410c-919c-a144d4261ada/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Start _get_guest_xml network_info=[{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be9ab357-37c6-410c-919c-a144d4261ada', 'attached_at': '', 'detached_at': '', 'volume_id': '570e5115-038a-4d98-a168-791774596b4e', 'serial': '570e5115-038a-4d98-a168-791774596b4e'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '91c123c8-d977-4599-b840-aae5dd27261e', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:05:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:05:26 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:05:27 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:05:27 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:05:27 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1840867b-e3ac-4b23-be03-d3a49ed78750]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:05:27 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b470d21-eed7-4102-b258-b2223175eefc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e] added
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c148a8b-5734-45c2-9460-cfd04ef4af2d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b082a-1c9a-44df-99b2-0fed4e39b563]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVWLouDp {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cVWLouDp" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874c242-4aa7-4cdc-88be-5fdd13431588]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cVWLouDp'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d295cb77-fbda-4e1d-aeaf-21ac082865f4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc708adb-d75c-4087-92a5-33fe525822fe]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7d087-e2e1-429b-85ca-57e6a68e49e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]
Nov 28 01:05:27 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825a29d-7154-41f0-bcd1-51b3a7fb7179]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[40582093-aabc-4d54-8725-cf97042b06f3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:27 user nova-compute[75266]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:27 user nova-compute[75266]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:05:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08d1df-79ce-4e5e-bf89-f04129b367ea]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:05:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23066333966326161', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333966326161', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-721476830',display_name='tempest-TestVolumeBootPattern-server-721476830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-721476830',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-b3ut2nd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:05:20Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be9ab357-37c6-410c-919c-a144d4261ada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid be9ab357-37c6-410c-919c-a144d4261ada {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:05:28 user nova-compute[75266]:   <uuid>be9ab357-37c6-410c-919c-a144d4261ada</uuid>
Nov 28 01:05:28 user nova-compute[75266]:   <name>instance-0000002c</name>
Nov 28 01:05:28 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:05:28 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:05:28 user nova-compute[75266]:   <metadata>
Nov 28 01:05:28 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:05:28 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:05:28 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-server-721476830</nova:name>
Nov 28 01:05:28 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:05:26</nova:creationTime>
Nov 28 01:05:28 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:05:28 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:05:28 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:05:28 user nova-compute[75266]:       <nova:owner>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 01:05:28 user nova-compute[75266]:       </nova:owner>
Nov 28 01:05:28 user nova-compute[75266]:       <nova:ports>
Nov 28 01:05:28 user nova-compute[75266]:         <nova:port uuid="c9a1e437-bf6a-4ce6-a156-37a6e3d251d7">
Nov 28 01:05:28 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 01:05:28 user nova-compute[75266]:         </nova:port>
Nov 28 01:05:28 user nova-compute[75266]:       </nova:ports>
Nov 28 01:05:28 user nova-compute[75266]:     </nova:instance>
Nov 28 01:05:28 user nova-compute[75266]:   </metadata>
Nov 28 01:05:28 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:05:28 user nova-compute[75266]:     <system>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="serial">be9ab357-37c6-410c-919c-a144d4261ada</entry>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="uuid">be9ab357-37c6-410c-919c-a144d4261ada</entry>
Nov 28 01:05:28 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:05:28 user nova-compute[75266]:     </system>
Nov 28 01:05:28 user nova-compute[75266]:   </sysinfo>
Nov 28 01:05:28 user nova-compute[75266]:   <os>
Nov 28 01:05:28 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:05:28 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:05:28 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:05:28 user nova-compute[75266]:   </os>
Nov 28 01:05:28 user nova-compute[75266]:   <features>
Nov 28 01:05:28 user nova-compute[75266]:     <acpi/>
Nov 28 01:05:28 user nova-compute[75266]:     <apic/>
Nov 28 01:05:28 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:05:28 user nova-compute[75266]:   </features>
Nov 28 01:05:28 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:05:28 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:05:28 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:05:28 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:05:28 user nova-compute[75266]:   </clock>
Nov 28 01:05:28 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:05:28 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:05:28 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:05:28 user nova-compute[75266]:   </cpu>
Nov 28 01:05:28 user nova-compute[75266]:   <devices>
Nov 28 01:05:28 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:05:28 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:05:28 user nova-compute[75266]:       <source dev="/dev/sdc"/>
Nov 28 01:05:28 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:05:28 user nova-compute[75266]:       <serial>570e5115-038a-4d98-a168-791774596b4e</serial>
Nov 28 01:05:28 user nova-compute[75266]:     </disk>
Nov 28 01:05:28 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:05:28 user nova-compute[75266]:       <mac address="fa:16:3e:aa:8d:5d"/>
Nov 28 01:05:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:05:28 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:05:28 user nova-compute[75266]:       <target dev="tapc9a1e437-bf"/>
Nov 28 01:05:28 user nova-compute[75266]:     </interface>
Nov 28 01:05:28 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:05:28 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/be9ab357-37c6-410c-919c-a144d4261ada/console.log" append="off"/>
Nov 28 01:05:28 user nova-compute[75266]:     </serial>
Nov 28 01:05:28 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:05:28 user nova-compute[75266]:     <video>
Nov 28 01:05:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:05:28 user nova-compute[75266]:     </video>
Nov 28 01:05:28 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:05:28 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:05:28 user nova-compute[75266]:     </rng>
Nov 28 01:05:28 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:05:28 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:05:28 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:05:28 user nova-compute[75266]:     </memballoon>
Nov 28 01:05:28 user nova-compute[75266]:   </devices>
Nov 28 01:05:28 user nova-compute[75266]: </domain>
Nov 28 01:05:28 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-721476830',display_name='tempest-TestVolumeBootPattern-server-721476830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-721476830',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-b3ut2nd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:05:20Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be9ab357-37c6-410c-919c-a144d4261ada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG os_vif [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2b8e0b7-367b-5681-8b88-eed41fc09010', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9a1e437-bf, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9a1e437-bf, col_values=(('qos', UUID('7aa3a183-bdf3-489b-87b4-9a6b46bc8d2d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9a1e437-bf, col_values=(('external_ids', {'iface-id': 'c9a1e437-bf6a-4ce6-a156-37a6e3d251d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:8d:5d', 'vm-uuid': 'be9ab357-37c6-410c-919c-a144d4261ada'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:28 user nova-compute[75266]: INFO os_vif [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf')
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:05:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:aa:8d:5d, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:05:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] No waiting events found dispatching network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:05:30 user nova-compute[75266]: WARNING nova.compute.manager [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received unexpected event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance with vm_state building and task_state spawning.
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:05:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Instance spawned successfully.
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:05:32 user nova-compute[75266]: INFO nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:05:32 user nova-compute[75266]: INFO nova.compute.manager [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Took 13.27 seconds to build instance.
Nov 28 01:05:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.392s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] No waiting events found dispatching network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:05:32 user nova-compute[75266]: WARNING nova.compute.manager [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received unexpected event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance with vm_state active and task_state None.
Nov 28 01:05:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:05:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:05:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=25.060874938964844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be9ab357-37c6-410c-919c-a144d4261ada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:05:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:05:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:05:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:05:36 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:05:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:05:37 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:05:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating instance_info_cache with network_info: [{"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:05:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-a4968288-fce2-45df-8ec1-9fc8b7db41cc" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:05:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:05:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:05:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:44 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4968288-fce2-45df-8ec1-9fc8b7db41cc is timed out.
Nov 28 01:05:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance a4968288-fce2-45df-8ec1-9fc8b7db41cc from the live domain config.
Nov 28 01:05:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENapXCDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:05:44 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ceb1df-0cf2-4f70-a37d-35f5cbc41f1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:05:44 user nova-compute[75266]: No targets found.
Nov 28 01:05:44 user nova-compute[75266]: iSNS:
Nov 28 01:05:44 user nova-compute[75266]: No targets found.
Nov 28 01:05:44 user nova-compute[75266]: STATIC:
Nov 28 01:05:44 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2
Nov 28 01:05:44 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:05:44 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:05:44 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:05:44 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:05:44 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:05:44 user nova-compute[75266]: FIRMWARE:
Nov 28 01:05:44 user nova-compute[75266]: No targets found.
Nov 28 01:05:44 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:05:44 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:05:44 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241bfe3-693e-4b35-99c4-5ce197b4c4bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac69ce-54c8-45f9-b0ea-81283124fb1d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:44 user nova-compute[75266]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:05:44 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 (non-flash)
Nov 28 01:05:44 user nova-compute[75266]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:05:44 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bada3a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb9e23e-6c9b-458b-b7b4-b96020a3d3b9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1a48c-828b-40ba-b619-01c0da16121b]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e625b-77d9-43d2-b3ec-b6b9dd90a2ca]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f061d-f77b-45a9-9129-faa0d6720f2f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d34b5e-6676-4bf3-8cc7-79775de997dc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011d23f-b638-4a3b-a728-5507fb2ac915]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260]
Nov 28 01:05:44 user nova-compute[75266]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2, portal: 172.16.0.220,3260] successful.
Nov 28 01:05:44 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef4cca-6872-46ab-8492-4becf074e1ba]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== disconnect_volume: return (285ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:05:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:05:45 user nova-compute[75266]: DEBUG nova.objects.instance [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:05:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:05:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:05:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:04 user nova-compute[75266]: INFO nova.compute.manager [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Terminating instance
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-unplugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Instance destroyed successfully.
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'resources' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T01:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-229525217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-229525217',id=39,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOoiDu67tR7mPD4Ahv+EVZUaBKP+XiaC7SnbsuKk5Kg2EZdBaWQrDdK48Zxa29VqFkJ235tL35fWdJopN9ifTRlqKpakxgM0g7GrZpLW8OW5tlrTl4wl5Xg24x+8AWTJA==',key_name='tempest-keypair-1399423202',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c236f1599d4a4fb181b4aa73058211',ramdisk_id='',reservation_id='r-ktyxne8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-107867446',owner_user_name='tempest-AttachVolumeShelveTestJSON-107867446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fd50f4f867e4efcad9e16d45dde6df0',uuid=15050b6f-4cc9-45e8-81f0-56ef01c3f703,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converting VIF {"id": "c212acf4-cf66-4cc0-8038-45ad6868166b", "address": "fa:16:3e:53:17:ac", "network": {"id": "e1a22e53-570e-48e3-97d1-6913705b3f8b", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1333066575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c236f1599d4a4fb181b4aa73058211", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc212acf4-cf", "ovs_interfaceid": "c212acf4-cf66-4cc0-8038-45ad6868166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG os_vif [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc212acf4-cf, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be8a9a84-0be3-40ff-a219-0086e3f96283) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:04 user nova-compute[75266]: INFO os_vif [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=c212acf4-cf66-4cc0-8038-45ad6868166b,network=Network(e1a22e53-570e-48e3-97d1-6913705b3f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc212acf4-cf')
Nov 28 01:06:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Deleting instance files /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703_del
Nov 28 01:06:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Deletion of /opt/stack/data/nova/instances/15050b6f-4cc9-45e8-81f0-56ef01c3f703_del complete
Nov 28 01:06:04 user nova-compute[75266]: INFO nova.compute.manager [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 01:06:04 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:06:04 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:06:05 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Took 0.61 seconds to deallocate network for instance.
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-deleted-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:05 user nova-compute[75266]: INFO nova.compute.manager [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Neutron deleted interface c212acf4-cf66-4cc0-8038-45ad6868166b; detaching it from the instance and deleting it from the info cache
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.network.neutron [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Detach interface failed, port_id=c212acf4-cf66-4cc0-8038-45ad6868166b, reason: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. {{(pid=75266) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:06:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:05 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Deleted allocations for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703
Nov 28 01:06:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Acquiring lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Lock "15050b6f-4cc9-45e8-81f0-56ef01c3f703-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] No waiting events found dispatching network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:06:06 user nova-compute[75266]: WARNING nova.compute.manager [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Received unexpected event network-vif-plugged-c212acf4-cf66-4cc0-8038-45ad6868166b for instance with vm_state deleted and task_state None.
Nov 28 01:06:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:14 user nova-compute[75266]: INFO nova.compute.manager [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Terminating instance
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-unplugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] No waiting events found dispatching network-vif-unplugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-unplugged-c54006a4-4d8f-444d-897a-419008313a91 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:06:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Instance destroyed successfully.
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'resources' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1303619575',display_name='tempest-AttachVolumeNegativeTest-server-1303619575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1303619575',id=43,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwyioFYYrzy8F+NUX5Ky5kFXporVF3GEo/6CywbWGUbIrn89eveMlhxaNDiTAuA4nTc6D7rl47f1VM0u2KrFNTDEZxG2jtNvGvJ9opo8Kgq4UkoMxsZsWx3u3NVjKHyA==',key_name='tempest-keypair-1774369941',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-9ykp3mwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=a4968288-fce2-45df-8ec1-9fc8b7db41cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "c54006a4-4d8f-444d-897a-419008313a91", "address": "fa:16:3e:49:54:0b", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc54006a4-4d", "ovs_interfaceid": "c54006a4-4d8f-444d-897a-419008313a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG os_vif [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc54006a4-4d, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3985e212-d762-475f-baa9-107465ee2a19) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:14 user nova-compute[75266]: INFO os_vif [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:54:0b,bridge_name='br-int',has_traffic_filtering=True,id=c54006a4-4d8f-444d-897a-419008313a91,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc54006a4-4d')
Nov 28 01:06:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Deleting instance files /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc_del
Nov 28 01:06:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Deletion of /opt/stack/data/nova/instances/a4968288-fce2-45df-8ec1-9fc8b7db41cc_del complete
Nov 28 01:06:14 user nova-compute[75266]: INFO nova.compute.manager [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 01:06:14 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:06:14 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:06:15 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:06:15 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Took 0.79 seconds to deallocate network for instance.
Nov 28 01:06:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:15 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:06:15 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:06:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:16 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Deleted allocations for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc
Nov 28 01:06:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Acquiring lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Lock "a4968288-fce2-45df-8ec1-9fc8b7db41cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] No waiting events found dispatching network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:06:16 user nova-compute[75266]: WARNING nova.compute.manager [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received unexpected event network-vif-plugged-c54006a4-4d8f-444d-897a-419008313a91 for instance with vm_state deleted and task_state None.
Nov 28 01:06:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Received event network-vif-deleted-c54006a4-4d8f-444d-897a-419008313a91 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:06:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:31 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:06:35 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.11566162109375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be9ab357-37c6-410c-919c-a144d4261ada actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:06:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:06:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:06:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:06:36 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:06:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:06:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:06:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:06:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:06:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:06:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'flavor' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:06:54 user nova-compute[75266]: INFO nova.compute.manager [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attaching volume 8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 to /dev/vdb
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.utils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf5d55-12e6-4c98-86d1-32537f74d47b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65b128-3f50-4d74-be66-a53593454d6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c655d2a-6889-45bb-baad-97727f267bd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d63349-9e84-45f5-a3fe-4f0577c675e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:06:54 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:06:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e29547-d35d-493c-8421-3ffcd2a34ec2]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG os_brick.utils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating existing volume attachment record: c2858105-6d46-44e1-9532-d772d4d4960e {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:06:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:07:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:02 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:02 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d76a42-e986-4771-ac05-5f38a96786fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:07:02 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afed219-eb52-4488-96e8-72633dfe2ce3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4] added
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db1be8-549b-4c45-8051-9cc6b5543143]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ab6fdc-968e-4bf3-bf9e-108c8a818e33]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cltRmbUD {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cltRmbUD" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6df8739-b742-4307-934a-3aadb86057d4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cltRmbUD'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277f272-a9d1-42aa-b96b-ad280dfe8ce5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835dc96-764e-4555-9078-bfa8e0ba85fc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bee4f36-615d-4864-abf4-a5c7a725f2dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260]
Nov 28 01:07:02 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260] successful.
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f5360-4143-480d-bcde-6cac8844d67a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4aa369-ed73-489b-8d57-b82d3b3de033]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:02 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:02 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd335a-19c4-4f44-8247-cb497da882d6]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:07:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26634643537346238', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634643537346238', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'flavor' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:07:03 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:07:03 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:07:03 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:07:03 user nova-compute[75266]:   <serial>8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4</serial>
Nov 28 01:07:03 user nova-compute[75266]: </disk>
Nov 28 01:07:03 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No VIF found with MAC fa:16:3e:af:12:7b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:07:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.885s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:05 user nova-compute[75266]: INFO nova.compute.manager [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Rescuing
Nov 28 01:07:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:06 user nova-compute[75266]: WARNING nova.compute.manager [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state active and task_state rescuing.
Nov 28 01:07:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance destroyed successfully.
Nov 28 01:07:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attempting a stable device rescue
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75266) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance directory exists: not creating {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 01:07:06 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Creating image(s)
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "2741bc359eefe7f2777b238327271256d49acb2a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "2741bc359eefe7f2777b238327271256d49acb2a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG nova.virt.images [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] a5699749-679c-437d-ba53-0bd7dd814a0e was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.part /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:08 user nova-compute[75266]: WARNING nova.compute.manager [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state active and task_state rescuing.
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.part /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.converted" returned: 0 in 0.525s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "2741bc359eefe7f2777b238327271256d49acb2a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.812s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "2741bc359eefe7f2777b238327271256d49acb2a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "2741bc359eefe7f2777b238327271256d49acb2a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:08 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a,backing_fmt=raw /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:07:09 user nova-compute[75266]: INFO nova.compute.claims [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Claim successful on node user
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a,backing_fmt=raw /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue" returned: 0 in 0.064s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "2741bc359eefe7f2777b238327271256d49acb2a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'migration_context' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Object Instance<cb931a0c-8094-497e-a63b-676c763d5f44> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start _get_guest_xml network_info=[{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "vif_mac": "fa:16:3e:af:12:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a5699749-679c-437d-ba53-0bd7dd814a0e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cb931a0c-8094-497e-a63b-676c763d5f44', 'attached_at': '', 'detached_at': '', 'volume_id': '8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'serial': '8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c2858105-6d46-44e1-9532-d772d4d4960e', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'resources' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Object Instance<cb931a0c-8094-497e-a63b-676c763d5f44> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'numa_topology' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Object Instance<cb931a0c-8094-497e-a63b-676c763d5f44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:07:09 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:09 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Object Instance<cb931a0c-8094-497e-a63b-676c763d5f44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:07:09 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:09 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:09 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[701ec9fd-b582-428e-b1dc-518e5a6e93eb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cltRmbUD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 01:07:09 user nova-compute[75266]: node.name = iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4
Nov 28 01:07:09 user nova-compute[75266]: node.tpgt = -1
Nov 28 01:07:09 user nova-compute[75266]: node.startup = automatic
Nov 28 01:07:09 user nova-compute[75266]: node.leading_login = No
Nov 28 01:07:09 user nova-compute[75266]: iface.iscsi_ifacename = default
Nov 28 01:07:09 user nova-compute[75266]: iface.net_ifacename = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.ipaddress = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.prefix_len = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.hwaddress = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.transport_name = tcp
Nov 28 01:07:09 user nova-compute[75266]: iface.initiatorname = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.vlan_id = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.vlan_priority = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.vlan_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.iface_num = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.mtu = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.port = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.bootproto = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.subnet_mask = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.gateway = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_alt_client_id = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_dns = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_learn_iqn = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_vendor_id_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_vendor_id = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.dhcp_slp_da = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.fragmentation = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.gratuitous_arp = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.incoming_forwarding = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.tos_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.tos = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.ttl = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.delayed_ack = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.tcp_nagle = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.tcp_wsf_state = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.tcp_wsf = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.tcp_timer_scale = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.tcp_timestamp = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.redirect = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.def_task_mgmt_timeout = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.header_digest = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.data_digest = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.immediate_data = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.initial_r2t = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.data_seq_inorder = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.data_pdu_inorder = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.erl = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.max_receive_data_len = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.first_burst_len = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.max_outstanding_r2t = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.max_burst_len = 0
Nov 28 01:07:09 user nova-compute[75266]: iface.chap_auth = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.bidi_chap = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.strict_login_compliance = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.discovery_auth = <empty>
Nov 28 01:07:09 user nova-compute[75266]: iface.discovery_logout = <empty>
Nov 28 01:07:09 user nova-compute[75266]: node.discovery_address = <empty>
Nov 28 01:07:09 user nova-compute[75266]: node.discovery_port = 0
Nov 28 01:07:09 user nova-compute[75266]: node.discovery_type = static
Nov 28 01:07:09 user nova-compute[75266]: node.session.initial_cmdsn = 0
Nov 28 01:07:09 user nova-compute[75266]: node.session.initial_login_retry_max = 8
Nov 28 01:07:09 user nova-compute[75266]: node.session.xmit_thread_priority = -20
Nov 28 01:07:09 user nova-compute[75266]: node.session.cmds_max = 128
Nov 28 01:07:09 user nova-compute[75266]: node.session.queue_depth = 32
Nov 28 01:07:09 user nova-compute[75266]: node.session.nr_sessions = 1
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.authmethod = CHAP
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.username = cltRmbUD
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.password = ***
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.username_in = <empty>
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.password_in = <empty>
Nov 28 01:07:09 user nova-compute[75266]: node.session.auth.chap_algs = MD5
Nov 28 01:07:09 user nova-compute[75266]: node.session.timeo.replacement_timeout = 120
Nov 28 01:07:09 user nova-compute[75266]: node.session.err_timeo.abort_timeout = 15
Nov 28 01:07:09 user nova-compute[75266]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 01:07:09 user nova-compute[75266]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 01:07:09 user nova-compute[75266]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.FastAbort = Yes
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.InitialR2T = No
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.ImmediateData = Yes
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.MaxConnections = 1
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 01:07:09 user nova-compute[75266]: node.session.iscsi.ERL = 0
Nov 28 01:07:09 user nova-compute[75266]: node.session.scan = manual
Nov 28 01:07:09 user nova-compute[75266]: node.session.reopen_max = 0
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].address = 172.16.0.220
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].port = 3260
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].startup = manual
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].tcp.window_size = 524288
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].tcp.type_of_service = 0
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].timeo.logout_timeout = 15
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].timeo.login_timeout = 15
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].timeo.auth_timeout = 45
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.DataDigest = None
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.IFMarker = No
Nov 28 01:07:09 user nova-compute[75266]: node.conn[0].iscsi.OFMarker = No
Nov 28 01:07:09 user nova-compute[75266]: # END RECORD
Nov 28 01:07:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc085c1-e22f-4a3f-911a-9a1427150a88]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e0a3b-1844-4dca-af39-611717362e1d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cltRmbUD {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cltRmbUD" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a483ef-87e1-4c5e-bf85-22a13bc3841a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cltRmbUD'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed923f09-d9d3-4b92-8545-89cb75cdaef3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa7fbb-9d86-4951-931d-363be9662ebf]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:09 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:09 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:09 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0489e4-9d18-4076-81f5-897e5a4fdca7]: (4, ('0 0 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '26634643537346238', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634643537346238', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-630894117',display_name='tempest-ServerStableDeviceRescueTest-server-630894117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-630894117',id=42,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcFw9WNsB/WfF2yeONFBuXL4tVJCd6mCroGfOuvO/4DxlzDl5xxqNI0VkgQOtsTie1dnmO3kC91WgA34H9SFtyuAC+3yOr2ehde8YyilFwrcwTfGsSkIzwL3ui6imEtuQ==',key_name='tempest-keypair-1738700815',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc686f7daecb4843b4b0b4f1e89dec89',ramdisk_id='',reservation_id='r-7hyyosdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-109213497',owner_user_name='tempest-ServerStableDeviceRescueTest-109213497-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e48c3f1b52e54c41b4499cbc2b767419',uuid=cb931a0c-8094-497e-a63b-676c763d5f44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "vif_mac": "fa:16:3e:af:12:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converting VIF {"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "vif_mac": "fa:16:3e:af:12:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'pci_devices' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.objects.base [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Object Instance<cb931a0c-8094-497e-a63b-676c763d5f44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:07:09 user nova-compute[75266]:   <uuid>cb931a0c-8094-497e-a63b-676c763d5f44</uuid>
Nov 28 01:07:09 user nova-compute[75266]:   <name>instance-0000002a</name>
Nov 28 01:07:09 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:07:09 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:07:09 user nova-compute[75266]:   <metadata>
Nov 28 01:07:09 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:07:09 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-630894117</nova:name>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:07:09</nova:creationTime>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:07:09 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:07:09 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:owner>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:user uuid="e48c3f1b52e54c41b4499cbc2b767419">tempest-ServerStableDeviceRescueTest-109213497-project-member</nova:user>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:project uuid="dc686f7daecb4843b4b0b4f1e89dec89">tempest-ServerStableDeviceRescueTest-109213497</nova:project>
Nov 28 01:07:09 user nova-compute[75266]:       </nova:owner>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:07:09 user nova-compute[75266]:       <nova:ports>
Nov 28 01:07:09 user nova-compute[75266]:         <nova:port uuid="ebf2a135-0f75-4334-9e00-ee1e757402cc">
Nov 28 01:07:09 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 01:07:09 user nova-compute[75266]:         </nova:port>
Nov 28 01:07:09 user nova-compute[75266]:       </nova:ports>
Nov 28 01:07:09 user nova-compute[75266]:     </nova:instance>
Nov 28 01:07:09 user nova-compute[75266]:   </metadata>
Nov 28 01:07:09 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:07:09 user nova-compute[75266]:     <system>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="serial">cb931a0c-8094-497e-a63b-676c763d5f44</entry>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="uuid">cb931a0c-8094-497e-a63b-676c763d5f44</entry>
Nov 28 01:07:09 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:07:09 user nova-compute[75266]:     </system>
Nov 28 01:07:09 user nova-compute[75266]:   </sysinfo>
Nov 28 01:07:09 user nova-compute[75266]:   <os>
Nov 28 01:07:09 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:07:09 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:07:09 user nova-compute[75266]:   </os>
Nov 28 01:07:09 user nova-compute[75266]:   <features>
Nov 28 01:07:09 user nova-compute[75266]:     <acpi/>
Nov 28 01:07:09 user nova-compute[75266]:     <apic/>
Nov 28 01:07:09 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:07:09 user nova-compute[75266]:   </features>
Nov 28 01:07:09 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:07:09 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:07:09 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:07:09 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:07:09 user nova-compute[75266]:   </clock>
Nov 28 01:07:09 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:07:09 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:07:09 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:07:09 user nova-compute[75266]:   </cpu>
Nov 28 01:07:09 user nova-compute[75266]:   <devices>
Nov 28 01:07:09 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:07:09 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:07:09 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk"/>
Nov 28 01:07:09 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:07:09 user nova-compute[75266]:     </disk>
Nov 28 01:07:09 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:07:09 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:07:09 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 01:07:09 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 01:07:09 user nova-compute[75266]:       <serial>8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4</serial>
Nov 28 01:07:09 user nova-compute[75266]:     </disk>
Nov 28 01:07:09 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:07:09 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:07:09 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue"/>
Nov 28 01:07:09 user nova-compute[75266]:       <target dev="vdc" bus="virtio"/>
Nov 28 01:07:09 user nova-compute[75266]:       <boot order="1"/>
Nov 28 01:07:09 user nova-compute[75266]:     </disk>
Nov 28 01:07:09 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:07:09 user nova-compute[75266]:       <mac address="fa:16:3e:af:12:7b"/>
Nov 28 01:07:09 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:09 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:07:09 user nova-compute[75266]:       <target dev="tapebf2a135-0f"/>
Nov 28 01:07:09 user nova-compute[75266]:     </interface>
Nov 28 01:07:09 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:07:09 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/console.log" append="off"/>
Nov 28 01:07:09 user nova-compute[75266]:     </serial>
Nov 28 01:07:09 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:07:09 user nova-compute[75266]:     <video>
Nov 28 01:07:09 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:09 user nova-compute[75266]:     </video>
Nov 28 01:07:09 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:07:09 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:07:09 user nova-compute[75266]:     </rng>
Nov 28 01:07:09 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:07:09 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:07:09 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:07:09 user nova-compute[75266]:     </memballoon>
Nov 28 01:07:09 user nova-compute[75266]:   </devices>
Nov 28 01:07:09 user nova-compute[75266]: </domain>
Nov 28 01:07:09 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:07:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance destroyed successfully.
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:07:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] No VIF found with MAC fa:16:3e:af:12:7b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.policy [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:07:09 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Creating image(s)
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "/opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk 1073741824" returned: 0 in 0.064s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Successfully created port: 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Cannot resize image /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Ensure instance console log exists: /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing instance network info cache due to event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Acquiring lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Acquired lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updated VIF entry in instance network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Releasing lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.compute.manager [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:11 user nova-compute[75266]: WARNING nova.compute.manager [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state active and task_state rescuing.
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Successfully updated port: 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquired lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:07:11 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updating instance_info_cache with network_info: [{"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Releasing lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Instance network_info: |[{"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Start _get_guest_xml network_info=[{"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:07:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:12 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-200637594',display_name='tempest-AttachVolumeNegativeTest-server-200637594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-200637594',id=45,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Bif8Ci23xJcv9z5EuVRGxlOGUZH9fj6PTcDLBbUIMNlihJb6dbPYGFWzdhVdwA5Fyx3DTUzSjNQb/pku2R6dtjeUzOYC2K2XJ4k0oV/7suMrccXQu13Ru5JBaEyqmDA==',key_name='tempest-keypair-999610924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-x9j4ees5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=7e025c3f-82f4-4b22-9429-50dd93b3b180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:07:12 user nova-compute[75266]:   <uuid>7e025c3f-82f4-4b22-9429-50dd93b3b180</uuid>
Nov 28 01:07:12 user nova-compute[75266]:   <name>instance-0000002d</name>
Nov 28 01:07:12 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:07:12 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:07:12 user nova-compute[75266]:   <metadata>
Nov 28 01:07:12 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:07:12 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:name>tempest-AttachVolumeNegativeTest-server-200637594</nova:name>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:07:12</nova:creationTime>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:07:12 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:07:12 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:owner>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:user uuid="6692115b7e8042c38fb8ecb84a5af250">tempest-AttachVolumeNegativeTest-471615281-project-member</nova:user>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:project uuid="45ead1a8b36544df9a2bf0feb223ba62">tempest-AttachVolumeNegativeTest-471615281</nova:project>
Nov 28 01:07:12 user nova-compute[75266]:       </nova:owner>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:07:12 user nova-compute[75266]:       <nova:ports>
Nov 28 01:07:12 user nova-compute[75266]:         <nova:port uuid="60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401">
Nov 28 01:07:12 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 01:07:12 user nova-compute[75266]:         </nova:port>
Nov 28 01:07:12 user nova-compute[75266]:       </nova:ports>
Nov 28 01:07:12 user nova-compute[75266]:     </nova:instance>
Nov 28 01:07:12 user nova-compute[75266]:   </metadata>
Nov 28 01:07:12 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:07:12 user nova-compute[75266]:     <system>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="serial">7e025c3f-82f4-4b22-9429-50dd93b3b180</entry>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="uuid">7e025c3f-82f4-4b22-9429-50dd93b3b180</entry>
Nov 28 01:07:12 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:07:12 user nova-compute[75266]:     </system>
Nov 28 01:07:12 user nova-compute[75266]:   </sysinfo>
Nov 28 01:07:12 user nova-compute[75266]:   <os>
Nov 28 01:07:12 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:07:12 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:07:12 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:07:12 user nova-compute[75266]:   </os>
Nov 28 01:07:12 user nova-compute[75266]:   <features>
Nov 28 01:07:12 user nova-compute[75266]:     <acpi/>
Nov 28 01:07:12 user nova-compute[75266]:     <apic/>
Nov 28 01:07:12 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:07:12 user nova-compute[75266]:   </features>
Nov 28 01:07:12 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:07:12 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:07:12 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:07:12 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:07:12 user nova-compute[75266]:   </clock>
Nov 28 01:07:12 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:07:12 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:07:12 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:07:12 user nova-compute[75266]:   </cpu>
Nov 28 01:07:12 user nova-compute[75266]:   <devices>
Nov 28 01:07:12 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:07:12 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:07:12 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk"/>
Nov 28 01:07:12 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:07:12 user nova-compute[75266]:     </disk>
Nov 28 01:07:12 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:07:12 user nova-compute[75266]:       <mac address="fa:16:3e:8e:50:ac"/>
Nov 28 01:07:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:12 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:07:12 user nova-compute[75266]:       <target dev="tap60c1f0ee-95"/>
Nov 28 01:07:12 user nova-compute[75266]:     </interface>
Nov 28 01:07:12 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:07:12 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/console.log" append="off"/>
Nov 28 01:07:12 user nova-compute[75266]:     </serial>
Nov 28 01:07:12 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:07:12 user nova-compute[75266]:     <video>
Nov 28 01:07:12 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:12 user nova-compute[75266]:     </video>
Nov 28 01:07:12 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:07:12 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:07:12 user nova-compute[75266]:     </rng>
Nov 28 01:07:12 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:07:12 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:07:12 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:07:12 user nova-compute[75266]:     </memballoon>
Nov 28 01:07:12 user nova-compute[75266]:   </devices>
Nov 28 01:07:12 user nova-compute[75266]: </domain>
Nov 28 01:07:12 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-200637594',display_name='tempest-AttachVolumeNegativeTest-server-200637594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-200637594',id=45,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Bif8Ci23xJcv9z5EuVRGxlOGUZH9fj6PTcDLBbUIMNlihJb6dbPYGFWzdhVdwA5Fyx3DTUzSjNQb/pku2R6dtjeUzOYC2K2XJ4k0oV/7suMrccXQu13Ru5JBaEyqmDA==',key_name='tempest-keypair-999610924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-x9j4ees5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=7e025c3f-82f4-4b22-9429-50dd93b3b180,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG os_vif [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddc7d71e-9d22-5798-a8af-15c51e09a6ed', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c1f0ee-95, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60c1f0ee-95, col_values=(('qos', UUID('97e57f75-9e4f-4f8c-91e1-845efe7beb50')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60c1f0ee-95, col_values=(('external_ids', {'iface-id': '60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:50:ac', 'vm-uuid': '7e025c3f-82f4-4b22-9429-50dd93b3b180'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:12 user nova-compute[75266]: INFO os_vif [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95')
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:8e:50:ac, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG nova.compute.manager [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-changed-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG nova.compute.manager [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Refreshing instance network info cache due to event network-changed-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Acquiring lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Acquired lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:13 user nova-compute[75266]: DEBUG nova.network.neutron [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Refreshing network info cache for port 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] No waiting events found dispatching network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:14 user nova-compute[75266]: WARNING nova.compute.manager [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received unexpected event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance with vm_state building and task_state spawning.
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updated VIF entry in instance network info cache for port 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updating instance_info_cache with network_info: [{"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Releasing lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:14 user nova-compute[75266]: WARNING nova.compute.manager [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state None.
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.compute.manager [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] No waiting events found dispatching network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:16 user nova-compute[75266]: WARNING nova.compute.manager [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received unexpected event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance with vm_state building and task_state spawning.
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:07:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Instance spawned successfully.
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:16 user nova-compute[75266]: INFO nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 28 01:07:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:07:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:16 user nova-compute[75266]: INFO nova.compute.manager [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Took 7.72 seconds to build instance.
Nov 28 01:07:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.825s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:18 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:07:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:18 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:07:19 user nova-compute[75266]: INFO nova.compute.claims [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Claim successful on node user
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:07:19 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:07:19 user nova-compute[75266]: INFO nova.virt.block_device [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Booting with volume ff347484-a484-4b80-a268-ad03926574fb at /dev/vda
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.policy [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.utils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f892e-f165-452d-acae-a92ad4f79b3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedecbe6-70a9-461c-a778-f9213882d149]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9e92b-ac42-4e43-82d1-84a6259cd512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeccc6f-2e2a-4d90-ba12-1b6d0533e493]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:07:19 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:07:19 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f273a536-15cf-4c27-bbd5-9b989ebf1ee3]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG os_brick.utils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:07:19 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating existing volume attachment record: a364a028-4329-43d7-b5c5-d45280d3db01 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:07:20 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Successfully created port: be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Successfully updated port: be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquired lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.compute.manager [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing instance network info cache due to event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Acquiring lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating instance_info_cache with network_info: [{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Releasing lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Instance network_info: |[{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Acquired lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG nova.network.neutron [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:07:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updated VIF entry in instance network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:07:22 user nova-compute[75266]: DEBUG nova.network.neutron [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating instance_info_cache with network_info: [{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Releasing lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:07:27 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Creating image(s)
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Did not create local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Ensure instance console log exists: /opt/stack/data/nova/instances/ae55cefb-c823-469a-9d62-e12005dfa9ae/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Start _get_guest_xml network_info=[{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlZJStLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae55cefb-c823-469a-9d62-e12005dfa9ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff347484-a484-4b80-a268-ad03926574fb', 'serial': 'ff347484-a484-4b80-a268-ad03926574fb'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'a364a028-4329-43d7-b5c5-d45280d3db01', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:07:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:27 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlZJStLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:07:27 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:27 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:07:27 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1698b0-5c00-4ac9-ab64-4127ff49291a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:07:27 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[42583d45-6cc6-4a27-a6bf-9c4c54ee198f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb] added
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b90aed-a23e-4e94-b89e-aa65e0ab42dd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6c34c5-d6f7-49d8-b1ea-b8fe3d4fcd7d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlZJStLP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AlZJStLP" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d104d529-82d0-4cb6-8154-d5137e67094c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AlZJStLP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7a81e6-d65e-45ae-b764-7ded3c8ad3dc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b310e300-7028-403b-ae5c-16d8909745a0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f404a4f-2042-47a5-a1ae-d647bf347e99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260]
Nov 28 01:07:27 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260] successful.
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c51523-1f1f-4faa-ad8e-981e4233b0ad]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0209487-fda9-427a-b696-55dd41f90dcb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:07:27 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:07:27 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[655baa25-4b4d-469f-bd41-935d585ef1db]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:07:27 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlZJStLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23163623832356233', 'path': '/dev/sdd'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163623832356233', 'path': '/dev/sdd'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-692539590',display_name='tempest-TestVolumeBootPattern-server-692539590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-692539590',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-5sz4q0yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:19Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=ae55cefb-c823-469a-9d62-e12005dfa9ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.objects.instance [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'pci_devices' on Instance uuid ae55cefb-c823-469a-9d62-e12005dfa9ae {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:07:28 user nova-compute[75266]:   <uuid>ae55cefb-c823-469a-9d62-e12005dfa9ae</uuid>
Nov 28 01:07:28 user nova-compute[75266]:   <name>instance-0000002e</name>
Nov 28 01:07:28 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:07:28 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:07:28 user nova-compute[75266]:   <metadata>
Nov 28 01:07:28 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:07:28 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:07:28 user nova-compute[75266]:       <nova:name>tempest-TestVolumeBootPattern-server-692539590</nova:name>
Nov 28 01:07:28 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:07:27</nova:creationTime>
Nov 28 01:07:28 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:07:28 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:07:28 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:07:28 user nova-compute[75266]:       <nova:owner>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:user uuid="76463cfb4f9c4edd908a0dc57546bb3a">tempest-TestVolumeBootPattern-1156826038-project-member</nova:user>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:project uuid="5fd11e875f8544b495ef779a772b8a27">tempest-TestVolumeBootPattern-1156826038</nova:project>
Nov 28 01:07:28 user nova-compute[75266]:       </nova:owner>
Nov 28 01:07:28 user nova-compute[75266]:       <nova:ports>
Nov 28 01:07:28 user nova-compute[75266]:         <nova:port uuid="be140d63-c2f7-4dfa-a2b4-83eb888ce731">
Nov 28 01:07:28 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 01:07:28 user nova-compute[75266]:         </nova:port>
Nov 28 01:07:28 user nova-compute[75266]:       </nova:ports>
Nov 28 01:07:28 user nova-compute[75266]:     </nova:instance>
Nov 28 01:07:28 user nova-compute[75266]:   </metadata>
Nov 28 01:07:28 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:07:28 user nova-compute[75266]:     <system>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="serial">ae55cefb-c823-469a-9d62-e12005dfa9ae</entry>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="uuid">ae55cefb-c823-469a-9d62-e12005dfa9ae</entry>
Nov 28 01:07:28 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:07:28 user nova-compute[75266]:     </system>
Nov 28 01:07:28 user nova-compute[75266]:   </sysinfo>
Nov 28 01:07:28 user nova-compute[75266]:   <os>
Nov 28 01:07:28 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:07:28 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:07:28 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:07:28 user nova-compute[75266]:   </os>
Nov 28 01:07:28 user nova-compute[75266]:   <features>
Nov 28 01:07:28 user nova-compute[75266]:     <acpi/>
Nov 28 01:07:28 user nova-compute[75266]:     <apic/>
Nov 28 01:07:28 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:07:28 user nova-compute[75266]:   </features>
Nov 28 01:07:28 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:07:28 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:07:28 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:07:28 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:07:28 user nova-compute[75266]:   </clock>
Nov 28 01:07:28 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:07:28 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:07:28 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:07:28 user nova-compute[75266]:   </cpu>
Nov 28 01:07:28 user nova-compute[75266]:   <devices>
Nov 28 01:07:28 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:07:28 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:07:28 user nova-compute[75266]:       <source dev="/dev/sdd"/>
Nov 28 01:07:28 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:07:28 user nova-compute[75266]:       <serial>ff347484-a484-4b80-a268-ad03926574fb</serial>
Nov 28 01:07:28 user nova-compute[75266]:     </disk>
Nov 28 01:07:28 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:07:28 user nova-compute[75266]:       <mac address="fa:16:3e:ea:5a:2d"/>
Nov 28 01:07:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:28 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:07:28 user nova-compute[75266]:       <target dev="tapbe140d63-c2"/>
Nov 28 01:07:28 user nova-compute[75266]:     </interface>
Nov 28 01:07:28 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:07:28 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/ae55cefb-c823-469a-9d62-e12005dfa9ae/console.log" append="off"/>
Nov 28 01:07:28 user nova-compute[75266]:     </serial>
Nov 28 01:07:28 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:07:28 user nova-compute[75266]:     <video>
Nov 28 01:07:28 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:28 user nova-compute[75266]:     </video>
Nov 28 01:07:28 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:07:28 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:07:28 user nova-compute[75266]:     </rng>
Nov 28 01:07:28 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:07:28 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:07:28 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:07:28 user nova-compute[75266]:     </memballoon>
Nov 28 01:07:28 user nova-compute[75266]:   </devices>
Nov 28 01:07:28 user nova-compute[75266]: </domain>
Nov 28 01:07:28 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-692539590',display_name='tempest-TestVolumeBootPattern-server-692539590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-692539590',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-5sz4q0yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:19Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=ae55cefb-c823-469a-9d62-e12005dfa9ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG os_vif [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6318db46-245b-5550-8480-b3477e0c3d6a', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe140d63-c2, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe140d63-c2, col_values=(('qos', UUID('cabc0324-0426-426e-a508-4d4f7c3e27d1')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe140d63-c2, col_values=(('external_ids', {'iface-id': 'be140d63-c2f7-4dfa-a2b4-83eb888ce731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:5a:2d', 'vm-uuid': 'ae55cefb-c823-469a-9d62-e12005dfa9ae'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:28 user nova-compute[75266]: INFO os_vif [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2')
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] No VIF found with MAC fa:16:3e:ea:5a:2d, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:07:29 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.compute.manager [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] No waiting events found dispatching network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:32 user nova-compute[75266]: WARNING nova.compute.manager [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received unexpected event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance with vm_state building and task_state spawning.
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:07:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Instance spawned successfully.
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:32 user nova-compute[75266]: INFO nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 28 01:07:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:07:32 user nova-compute[75266]: INFO nova.compute.manager [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Took 13.78 seconds to build instance.
Nov 28 01:07:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.893s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] No waiting events found dispatching network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:34 user nova-compute[75266]: WARNING nova.compute.manager [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received unexpected event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance with vm_state active and task_state None.
Nov 28 01:07:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:07:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:37 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:37 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8352MB free_disk=24.98053741455078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance b375c38b-e368-4e2a-b988-0ae27130a878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be9ab357-37c6-410c-919c-a144d4261ada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ae55cefb-c823-469a-9d62-e12005dfa9ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:07:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:07:38 user nova-compute[75266]: INFO nova.compute.claims [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Claim successful on node user
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:07:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:07:38 user nova-compute[75266]: DEBUG nova.policy [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cab44b27feeb477a92838fade4c11fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230df1c12b5a408b81c364b1da501b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:07:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Creating image(s)
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "/opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "/opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "/opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk 1073741824" returned: 0 in 0.052s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Successfully created port: dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Cannot resize image /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Ensure instance console log exists: /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Skipping network cache update for instance because it is Building. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:07:39 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid b375c38b-e368-4e2a-b988-0ae27130a878 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Successfully updated port: dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquired lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-changed-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Refreshing instance network info cache due to event network-changed-dffd1c11-03f9-411c-b673-9954417d6307. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Acquiring lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updating instance_info_cache with network_info: [{"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-b375c38b-e368-4e2a-b988-0ae27130a878" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Updating instance_info_cache with network_info: [{"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Releasing lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Instance network_info: |[{"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Acquired lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Refreshing network info cache for port dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Start _get_guest_xml network_info=[{"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:07:40 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:40 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974536440',display_name='tempest-VolumesActionsTest-instance-1974536440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974536440',id=47,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='230df1c12b5a408b81c364b1da501b59',ramdisk_id='',reservation_id='r-600jpczq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580383771',owner_user_name='tempest-VolumesActionsTest-580383771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:39Z,user_data=None,user_id='cab44b27feeb477a92838fade4c11fa8',uuid=658d11ca-16ef-48c4-9c87-78b338c5ab2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converting VIF {"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.objects.instance [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lazy-loading 'pci_devices' on Instance uuid 658d11ca-16ef-48c4-9c87-78b338c5ab2a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:07:40 user nova-compute[75266]:   <uuid>658d11ca-16ef-48c4-9c87-78b338c5ab2a</uuid>
Nov 28 01:07:40 user nova-compute[75266]:   <name>instance-0000002f</name>
Nov 28 01:07:40 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:07:40 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:07:40 user nova-compute[75266]:   <metadata>
Nov 28 01:07:40 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:07:40 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:name>tempest-VolumesActionsTest-instance-1974536440</nova:name>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:07:40</nova:creationTime>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:07:40 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:07:40 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:owner>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:user uuid="cab44b27feeb477a92838fade4c11fa8">tempest-VolumesActionsTest-580383771-project-member</nova:user>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:project uuid="230df1c12b5a408b81c364b1da501b59">tempest-VolumesActionsTest-580383771</nova:project>
Nov 28 01:07:40 user nova-compute[75266]:       </nova:owner>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:07:40 user nova-compute[75266]:       <nova:ports>
Nov 28 01:07:40 user nova-compute[75266]:         <nova:port uuid="dffd1c11-03f9-411c-b673-9954417d6307">
Nov 28 01:07:40 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 01:07:40 user nova-compute[75266]:         </nova:port>
Nov 28 01:07:40 user nova-compute[75266]:       </nova:ports>
Nov 28 01:07:40 user nova-compute[75266]:     </nova:instance>
Nov 28 01:07:40 user nova-compute[75266]:   </metadata>
Nov 28 01:07:40 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:07:40 user nova-compute[75266]:     <system>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="serial">658d11ca-16ef-48c4-9c87-78b338c5ab2a</entry>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="uuid">658d11ca-16ef-48c4-9c87-78b338c5ab2a</entry>
Nov 28 01:07:40 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:07:40 user nova-compute[75266]:     </system>
Nov 28 01:07:40 user nova-compute[75266]:   </sysinfo>
Nov 28 01:07:40 user nova-compute[75266]:   <os>
Nov 28 01:07:40 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:07:40 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:07:40 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:07:40 user nova-compute[75266]:   </os>
Nov 28 01:07:40 user nova-compute[75266]:   <features>
Nov 28 01:07:40 user nova-compute[75266]:     <acpi/>
Nov 28 01:07:40 user nova-compute[75266]:     <apic/>
Nov 28 01:07:40 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:07:40 user nova-compute[75266]:   </features>
Nov 28 01:07:40 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:07:40 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:07:40 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:07:40 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:07:40 user nova-compute[75266]:   </clock>
Nov 28 01:07:40 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:07:40 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:07:40 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:07:40 user nova-compute[75266]:   </cpu>
Nov 28 01:07:40 user nova-compute[75266]:   <devices>
Nov 28 01:07:40 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:07:40 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:07:40 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk"/>
Nov 28 01:07:40 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:07:40 user nova-compute[75266]:     </disk>
Nov 28 01:07:40 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:07:40 user nova-compute[75266]:       <mac address="fa:16:3e:6e:26:a2"/>
Nov 28 01:07:40 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:40 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:07:40 user nova-compute[75266]:       <target dev="tapdffd1c11-03"/>
Nov 28 01:07:40 user nova-compute[75266]:     </interface>
Nov 28 01:07:40 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:07:40 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/console.log" append="off"/>
Nov 28 01:07:40 user nova-compute[75266]:     </serial>
Nov 28 01:07:40 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:07:40 user nova-compute[75266]:     <video>
Nov 28 01:07:40 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:07:40 user nova-compute[75266]:     </video>
Nov 28 01:07:40 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:07:40 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:07:40 user nova-compute[75266]:     </rng>
Nov 28 01:07:40 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:07:40 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:07:40 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:07:40 user nova-compute[75266]:     </memballoon>
Nov 28 01:07:40 user nova-compute[75266]:   </devices>
Nov 28 01:07:40 user nova-compute[75266]: </domain>
Nov 28 01:07:40 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974536440',display_name='tempest-VolumesActionsTest-instance-1974536440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974536440',id=47,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='230df1c12b5a408b81c364b1da501b59',ramdisk_id='',reservation_id='r-600jpczq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580383771',owner_user_name='tempest-VolumesActionsTest-580383771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:07:39Z,user_data=None,user_id='cab44b27feeb477a92838fade4c11fa8',uuid=658d11ca-16ef-48c4-9c87-78b338c5ab2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converting VIF {"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG os_vif [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0868f975-dd15-50b8-a950-97cc80ccd63b', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdffd1c11-03, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdffd1c11-03, col_values=(('qos', UUID('fefb76f8-8586-4ec0-ac85-73014ab7fbd9')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdffd1c11-03, col_values=(('external_ids', {'iface-id': 'dffd1c11-03f9-411c-b673-9954417d6307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:26:a2', 'vm-uuid': '658d11ca-16ef-48c4-9c87-78b338c5ab2a'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:40 user nova-compute[75266]: INFO os_vif [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03')
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] No VIF found with MAC fa:16:3e:6e:26:a2, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Updated VIF entry in instance network info cache for port dffd1c11-03f9-411c-b673-9954417d6307. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Updating instance_info_cache with network_info: [{"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:07:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Releasing lock "refresh_cache-658d11ca-16ef-48c4-9c87-78b338c5ab2a" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:07:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] No waiting events found dispatching network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:42 user nova-compute[75266]: WARNING nova.compute.manager [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received unexpected event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 for instance with vm_state building and task_state spawning.
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:07:44 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Instance spawned successfully.
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:07:44 user nova-compute[75266]: INFO nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:07:44 user nova-compute[75266]: INFO nova.compute.manager [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Took 5.80 seconds to build instance.
Nov 28 01:07:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.894s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:07:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] No waiting events found dispatching network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:07:44 user nova-compute[75266]: WARNING nova.compute.manager [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received unexpected event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 for instance with vm_state active and task_state None.
Nov 28 01:07:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:07:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:50 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:07:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:07:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:08:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:08:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:10 user nova-compute[75266]: INFO nova.compute.manager [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Terminating instance
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-unplugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] No waiting events found dispatching network-vif-unplugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-unplugged-cbe5cb94-844b-4115-a79a-e58beb743d42 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Instance destroyed successfully.
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lazy-loading 'resources' on Instance uuid b375c38b-e368-4e2a-b988-0ae27130a878 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T00:59:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1401399961',display_name='tempest-ServersNegativeTestJSON-server-1401399961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1401399961',id=38,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T00:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaf19f7d462f4fa2a9204479d1d35811',ramdisk_id='',reservation_id='r-g5cch82i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-647957928',owner_user_name='tempest-ServersNegativeTestJSON-647957928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T00:59:31Z,user_data=None,user_id='8679237c178f427a9cc7887c21fe12cf',uuid=b375c38b-e368-4e2a-b988-0ae27130a878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converting VIF {"id": "cbe5cb94-844b-4115-a79a-e58beb743d42", "address": "fa:16:3e:80:05:f2", "network": {"id": "860d6281-89e3-48fc-9050-984da4b55006", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-652698444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaf19f7d462f4fa2a9204479d1d35811", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe5cb94-84", "ovs_interfaceid": "cbe5cb94-844b-4115-a79a-e58beb743d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG os_vif [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbe5cb94-84, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4777726c-02a6-447b-8d5d-e10c537af9e8) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:10 user nova-compute[75266]: INFO os_vif [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:05:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe5cb94-844b-4115-a79a-e58beb743d42,network=Network(860d6281-89e3-48fc-9050-984da4b55006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe5cb94-84')
Nov 28 01:08:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Deleting instance files /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878_del
Nov 28 01:08:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Deletion of /opt/stack/data/nova/instances/b375c38b-e368-4e2a-b988-0ae27130a878_del complete
Nov 28 01:08:10 user nova-compute[75266]: INFO nova.compute.manager [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 01:08:10 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:08:10 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:08:11 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Took 0.54 seconds to deallocate network for instance.
Nov 28 01:08:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:08:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:11 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Deleted allocations for instance b375c38b-e368-4e2a-b988-0ae27130a878
Nov 28 01:08:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "b375c38b-e368-4e2a-b988-0ae27130a878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Acquiring lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Lock "b375c38b-e368-4e2a-b988-0ae27130a878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] No waiting events found dispatching network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:12 user nova-compute[75266]: WARNING nova.compute.manager [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received unexpected event network-vif-plugged-cbe5cb94-844b-4115-a79a-e58beb743d42 for instance with vm_state deleted and task_state None.
Nov 28 01:08:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Received event network-vif-deleted-cbe5cb94-844b-4115-a79a-e58beb743d42 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid be9ab357-37c6-410c-919c-a144d4261ada {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid ae55cefb-c823-469a-9d62-e12005dfa9ae {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 658d11ca-16ef-48c4-9c87-78b338c5ab2a {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "be9ab357-37c6-410c-919c-a144d4261ada" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "be9ab357-37c6-410c-919c-a144d4261ada" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:08:35 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:08:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:08:37 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:08:37 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8309MB free_disk=24.976295471191406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be9ab357-37c6-410c-919c-a144d4261ada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance ae55cefb-c823-469a-9d62-e12005dfa9ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:08:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:08:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:08:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:08:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:08:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:08:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:08:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:56 user nova-compute[75266]: INFO nova.compute.manager [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Unrescuing
Nov 28 01:08:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'flavor' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:08:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:57 user nova-compute[75266]: WARNING nova.compute.manager [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing instance network info cache due to event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG nova.network.neutron [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:57 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance destroyed successfully.
Nov 28 01:08:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated VIF entry in instance network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:08:59 user nova-compute[75266]: WARNING nova.compute.manager [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state rescued and task_state unrescuing.
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.compute.manager [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing instance network info cache due to event network-changed-ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Acquiring lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Acquired lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Refreshing network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updated VIF entry in instance network info cache for port ebf2a135-0f75-4334-9e00-ee1e757402cc. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG nova.network.neutron [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [{"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:08:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Releasing lock "refresh_cache-cb931a0c-8094-497e-a63b-676c763d5f44" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:09:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-changed-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Refreshing instance network info cache due to event network-changed-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Acquiring lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Acquired lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.network.neutron [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Refreshing network info cache for port 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:01 user nova-compute[75266]: DEBUG nova.compute.manager [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:09:01 user nova-compute[75266]: WARNING nova.compute.manager [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state active and task_state None.
Nov 28 01:09:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG nova.network.neutron [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updated VIF entry in instance network info cache for port 60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG nova.network.neutron [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updating instance_info_cache with network_info: [{"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Releasing lock "refresh_cache-7e025c3f-82f4-4b22-9429-50dd93b3b180" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:02 user nova-compute[75266]: INFO nova.compute.manager [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Attaching volume 952b1555-fe5c-463e-8cf2-75378239fadb to /dev/vdb
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.utils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19561dc-d5ec-4d10-8a10-aa498ae755ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6aca05-a02a-483e-9d4b-09d58f074517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d8e9c-c776-48fb-901d-1261069b40d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d9539-b254-43cd-af87-abccbc8eaebe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:09:03 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:09:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9669fca2-af30-42a5-bd5c-761cf215a9a4]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG os_brick.utils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updating existing volume attachment record: 26b0baad-ff0f-41ab-a9db-c724f3c35756 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:09:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqolBCAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:09:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:09:10 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:09:10 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2add1a9-4977-4138-9178-423e992b3b4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:09:10 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed93f9-accd-473c-9a54-4df59980c952]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb] added
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f80af44-667f-4b8a-aebd-5fc5cce6c68e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf81a7-88a8-4470-8e2d-4027c389bc73]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqolBCAt {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqolBCAt" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd91db-c996-4f12-88c3-07717ca09fd7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rqolBCAt'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc909bc-d83a-4c5a-90e3-89c53ecb6228]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eb6cac-3b59-4e49-bb3c-db64881b1602]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2b026-1dd4-44e0-bfbe-55955801cb33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260]
Nov 28 01:09:10 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260] successful.
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b196233-5c7b-40e7-845c-f6fe4cb5821e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f9137-04c1-49f4-9d1c-fe47aaefd1f8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:10 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing instance network info cache due to event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Acquiring lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Acquired lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[da75da42-bd2b-4145-9427-61318aa53c55]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqolBCAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updated VIF entry in instance network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating instance_info_cache with network_info: [{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Releasing lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26434343034313764', 'path': '/dev/sde'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434343034313764', 'path': '/dev/sde'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:09:11 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:09:11 user nova-compute[75266]:   <source dev="/dev/sde"/>
Nov 28 01:09:11 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:09:11 user nova-compute[75266]:   <serial>952b1555-fe5c-463e-8cf2-75378239fadb</serial>
Nov 28 01:09:11 user nova-compute[75266]: </disk>
Nov 28 01:09:11 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:09:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] No VIF found with MAC fa:16:3e:8e:50:ac, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.286s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing instance network info cache due to event network-changed-be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Acquiring lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Acquired lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.network.neutron [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Refreshing network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:12 user nova-compute[75266]: INFO nova.compute.manager [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Terminating instance
Nov 28 01:09:12 user nova-compute[75266]: DEBUG nova.compute.manager [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.compute.manager [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Detaching volume 952b1555-fe5c-463e-8cf2-75378239fadb
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.network.neutron [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updated VIF entry in instance network info cache for port be140d63-c2f7-4dfa-a2b4-83eb888ce731. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.network.neutron [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating instance_info_cache with network_info: [{"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.virt.block_device [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Attempting to driver detach volume 952b1555-fe5c-463e-8cf2-75378239fadb from mountpoint /dev/vdb
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Releasing lock "refresh_cache-ae55cefb-c823-469a-9d62-e12005dfa9ae" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Attempting to detach device vdb from instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:09:13 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:09:13 user nova-compute[75266]:   <source dev="/dev/sde"/>
Nov 28 01:09:13 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:09:13 user nova-compute[75266]:   <serial>952b1555-fe5c-463e-8cf2-75378239fadb</serial>
Nov 28 01:09:13 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:09:13 user nova-compute[75266]: </disk>
Nov 28 01:09:13 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Instance destroyed successfully.
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.objects.instance [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid ae55cefb-c823-469a-9d62-e12005dfa9ae {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 from the persistent domain config.
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:09:13 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:09:13 user nova-compute[75266]:   <source dev="/dev/sde"/>
Nov 28 01:09:13 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:09:13 user nova-compute[75266]:   <serial>952b1555-fe5c-463e-8cf2-75378239fadb</serial>
Nov 28 01:09:13 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:09:13 user nova-compute[75266]: </disk>
Nov 28 01:09:13 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-692539590',display_name='tempest-TestVolumeBootPattern-server-692539590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-692539590',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-5sz4q0yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:07:33Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=ae55cefb-c823-469a-9d62-e12005dfa9ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "address": "fa:16:3e:ea:5a:2d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe140d63-c2", "ovs_interfaceid": "be140d63-c2f7-4dfa-a2b4-83eb888ce731", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_vif [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe140d63-c2, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cabc0324-0426-426e-a508-4d4f7c3e27d1) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:13 user nova-compute[75266]: INFO os_vif [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5a:2d,bridge_name='br-int',has_traffic_filtering=True,id=be140d63-c2f7-4dfa-a2b4-83eb888ce731,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe140d63-c2')
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AlZJStLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:09:13 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f141256-1514-4afb-b7ab-da82771bbf52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:09:13 user nova-compute[75266]: No targets found.
Nov 28 01:09:13 user nova-compute[75266]: iSNS:
Nov 28 01:09:13 user nova-compute[75266]: No targets found.
Nov 28 01:09:13 user nova-compute[75266]: STATIC:
Nov 28 01:09:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb
Nov 28 01:09:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4
Nov 28 01:09:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:09:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:13 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb
Nov 28 01:09:13 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:13 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:13 user nova-compute[75266]: FIRMWARE:
Nov 28 01:09:13 user nova-compute[75266]: No targets found.
Nov 28 01:09:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:09:13 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:09:13 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf8953c-def5-4161-a998-5ceffe226d1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed6698-877f-44e7-a4e8-ecdd56a6fe86]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb (non-flash)
Nov 28 01:09:13 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c3f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb'): ({'sdd'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdd {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[273e6787-2614-4ac7-afec-2a2a1d8f2afe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf5ac0d-f950-4901-bc89-1b9977d35744]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdd {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f48369-3fcd-4a89-89e7-a4bb0961d637]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1c9738-b3fe-43b9-b549-dc3092a35798]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdd have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ddfc8-94b2-45bd-8619-a6349771540e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3e408-dbd0-48e2-ad4a-b257a627d02a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260]
Nov 28 01:09:13 user nova-compute[75266]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb, portal: 172.16.0.220,3260] successful.
Nov 28 01:09:13 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff347484-a484-4b80-a268-ad03926574fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e22da-ef04-44ce-967b-d59e51ed7c12]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (326ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Deleting instance files /opt/stack/data/nova/instances/ae55cefb-c823-469a-9d62-e12005dfa9ae_del
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Deletion of /opt/stack/data/nova/instances/ae55cefb-c823-469a-9d62-e12005dfa9ae_del complete
Nov 28 01:09:13 user nova-compute[75266]: INFO nova.compute.manager [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 28 01:09:13 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:09:13 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:14 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Took 0.48 seconds to deallocate network for instance.
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-unplugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] No waiting events found dispatching network-vif-unplugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-unplugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Acquiring lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] No waiting events found dispatching network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:09:14 user nova-compute[75266]: WARNING nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received unexpected event network-vif-plugged-be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance with vm_state active and task_state deleting.
Nov 28 01:09:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Received event network-vif-deleted-be140d63-c2f7-4dfa-a2b4-83eb888ce731 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:15 user nova-compute[75266]: INFO nova.compute.manager [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Took 0.83 seconds to detach 1 volumes for instance.
Nov 28 01:09:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:15 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:09:15 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:09:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:15 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance ae55cefb-c823-469a-9d62-e12005dfa9ae
Nov 28 01:09:15 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "ae55cefb-c823-469a-9d62-e12005dfa9ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.027s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:29 user nova-compute[75266]: INFO nova.compute.manager [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Detaching volume 8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4
Nov 28 01:09:29 user nova-compute[75266]: INFO nova.virt.block_device [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Attempting to driver detach volume 8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 from mountpoint /dev/vdb
Nov 28 01:09:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Attempting to detach device vdb from instance cb931a0c-8094-497e-a63b-676c763d5f44 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:09:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:09:29 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:09:29 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:09:29 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:09:29 user nova-compute[75266]:   <serial>8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4</serial>
Nov 28 01:09:29 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:09:29 user nova-compute[75266]: </disk>
Nov 28 01:09:29 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:09:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Successfully detached device vdb from instance cb931a0c-8094-497e-a63b-676c763d5f44 from the persistent domain config.
Nov 28 01:09:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb931a0c-8094-497e-a63b-676c763d5f44 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:09:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:09:29 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:09:29 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:09:29 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:09:29 user nova-compute[75266]:   <serial>8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4</serial>
Nov 28 01:09:29 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:09:29 user nova-compute[75266]: </disk>
Nov 28 01:09:29 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:09:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:09:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 is timed out.
Nov 28 01:09:34 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully detached device vdb from instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 from the live domain config.
Nov 28 01:09:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqolBCAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:09:34 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bb3378-2520-465a-b12a-3bdb3391d9d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:09:34 user nova-compute[75266]: No targets found.
Nov 28 01:09:34 user nova-compute[75266]: iSNS:
Nov 28 01:09:34 user nova-compute[75266]: No targets found.
Nov 28 01:09:34 user nova-compute[75266]: STATIC:
Nov 28 01:09:34 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb
Nov 28 01:09:34 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:34 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:34 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4
Nov 28 01:09:34 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:34 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:34 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:09:34 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:34 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:34 user nova-compute[75266]: FIRMWARE:
Nov 28 01:09:34 user nova-compute[75266]: No targets found.
Nov 28 01:09:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:09:34 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:09:34 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3626e-cf0c-44c7-a6db-3882ed2ebb86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f754ef-c2d3-4f06-977c-1ad7e6fc597b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:34 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:34 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:34 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:34 user nova-compute[75266]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb (non-flash)
Nov 28 01:09:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c5ef130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb'): ({'sde'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Removing single pathed devices sde {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c6a434-d8f5-4bde-a2e4-d3739284b683]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8466e45-3267-40e6-ad01-a93697787bc1]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flushing IO for device /dev/sde {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f248f51-1d98-4c0c-9db9-58b60d74bde9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c100835e-739e-4dfd-9400-70756153bf68]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] SCSI volumes sde have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193233a-dde0-43d1-89e1-56cd78432f68]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9845e74f-50de-4062-9aae-f00004b2d858]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260]
Nov 28 01:09:34 user nova-compute[75266]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb, portal: 172.16.0.220,3260] successful.
Nov 28 01:09:34 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952b1555-fe5c-463e-8cf2-75378239fadb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d19679-be49-4c15-aa46-3bbc39765f89]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] <== disconnect_volume: return (309ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:09:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'flavor' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.084s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:35 user nova-compute[75266]: INFO nova.compute.manager [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Terminating instance
Nov 28 01:09:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-unplugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] No waiting events found dispatching network-vif-unplugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-unplugged-dffd1c11-03f9-411c-b673-9954417d6307 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:09:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Instance destroyed successfully.
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.objects.instance [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lazy-loading 'resources' on Instance uuid 658d11ca-16ef-48c4-9c87-78b338c5ab2a {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1974536440',display_name='tempest-VolumesActionsTest-instance-1974536440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1974536440',id=47,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='230df1c12b5a408b81c364b1da501b59',ramdisk_id='',reservation_id='r-600jpczq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-580383771',owner_user_name='tempest-VolumesActionsTest-580383771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:07:44Z,user_data=None,user_id='cab44b27feeb477a92838fade4c11fa8',uuid=658d11ca-16ef-48c4-9c87-78b338c5ab2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converting VIF {"id": "dffd1c11-03f9-411c-b673-9954417d6307", "address": "fa:16:3e:6e:26:a2", "network": {"id": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2039666735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "230df1c12b5a408b81c364b1da501b59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffd1c11-03", "ovs_interfaceid": "dffd1c11-03f9-411c-b673-9954417d6307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG os_vif [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdffd1c11-03, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fefb76f8-8586-4ec0-ac85-73014ab7fbd9) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:36 user nova-compute[75266]: INFO os_vif [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:26:a2,bridge_name='br-int',has_traffic_filtering=True,id=dffd1c11-03f9-411c-b673-9954417d6307,network=Network(07239a8a-ca6d-4bd7-98d4-a5efe6ca827a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffd1c11-03')
Nov 28 01:09:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Deleting instance files /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a_del
Nov 28 01:09:36 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Deletion of /opt/stack/data/nova/instances/658d11ca-16ef-48c4-9c87-78b338c5ab2a_del complete
Nov 28 01:09:36 user nova-compute[75266]: INFO nova.compute.manager [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:09:36 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:37 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Took 0.71 seconds to deallocate network for instance.
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:37 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Deleted allocations for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a
Nov 28 01:09:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:09:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8518MB free_disk=24.985755920410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Acquiring lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Lock "658d11ca-16ef-48c4-9c87-78b338c5ab2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] No waiting events found dispatching network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:09:38 user nova-compute[75266]: WARNING nova.compute.manager [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received unexpected event network-vif-plugged-dffd1c11-03f9-411c-b673-9954417d6307 for instance with vm_state deleted and task_state None.
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Received event network-vif-deleted-dffd1c11-03f9-411c-b673-9954417d6307 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance cb931a0c-8094-497e-a63b-676c763d5f44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance be9ab357-37c6-410c-919c-a144d4261ada actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:09:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:09:40 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:09:41 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:09:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:09:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:09:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:09:49 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb931a0c-8094-497e-a63b-676c763d5f44 is timed out.
Nov 28 01:09:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Successfully detached device vdb from instance cb931a0c-8094-497e-a63b-676c763d5f44 from the live domain config.
Nov 28 01:09:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cltRmbUD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:09:49 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d76f8eb-970d-42f8-ad2a-c272aac20075]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:09:49 user nova-compute[75266]: No targets found.
Nov 28 01:09:49 user nova-compute[75266]: iSNS:
Nov 28 01:09:49 user nova-compute[75266]: No targets found.
Nov 28 01:09:49 user nova-compute[75266]: STATIC:
Nov 28 01:09:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4
Nov 28 01:09:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:09:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:09:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:09:49 user nova-compute[75266]: FIRMWARE:
Nov 28 01:09:49 user nova-compute[75266]: No targets found.
Nov 28 01:09:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:09:49 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:09:49 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e238162-7fe1-43b3-a5fd-ff8a971abf82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1842b1-0f94-4f3a-9764-0a21b926a16f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:49 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:09:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:09:49 user nova-compute[75266]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 (non-flash)
Nov 28 01:09:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c15a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6dabf4-18c0-4594-b4b7-595a41103bf0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07d8450-49ab-4a37-bd96-ef97c65be989]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[129bdbb9-bf23-4345-bc7a-fbfe8e34bab1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b928f5-e52e-414b-91c2-dbfdb640b673]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8f2ae-40d3-4aff-8609-1bbf74ad90a8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0ee20d-5af0-4f2b-a248-e36215a25bcc]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260]
Nov 28 01:09:50 user nova-compute[75266]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4, portal: 172.16.0.220,3260] successful.
Nov 28 01:09:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b29bec-b562-4f8f-9660-3297426f1184]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] <== disconnect_volume: return (286ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:09:50 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'flavor' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:09:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:09:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:03 user nova-compute[75266]: INFO nova.compute.manager [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Terminating instance
Nov 28 01:10:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-unplugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] No waiting events found dispatching network-vif-unplugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-unplugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:10:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Instance destroyed successfully.
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'resources' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-200637594',display_name='tempest-AttachVolumeNegativeTest-server-200637594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-200637594',id=45,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Bif8Ci23xJcv9z5EuVRGxlOGUZH9fj6PTcDLBbUIMNlihJb6dbPYGFWzdhVdwA5Fyx3DTUzSjNQb/pku2R6dtjeUzOYC2K2XJ4k0oV/7suMrccXQu13Ru5JBaEyqmDA==',key_name='tempest-keypair-999610924',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:07:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45ead1a8b36544df9a2bf0feb223ba62',ramdisk_id='',reservation_id='r-x9j4ees5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471615281',owner_user_name='tempest-AttachVolumeNegativeTest-471615281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6692115b7e8042c38fb8ecb84a5af250',uuid=7e025c3f-82f4-4b22-9429-50dd93b3b180,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converting VIF {"id": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "address": "fa:16:3e:8e:50:ac", "network": {"id": "17b52fdf-8b78-4226-b39e-12aa8c2e462a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-794874873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45ead1a8b36544df9a2bf0feb223ba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1f0ee-95", "ovs_interfaceid": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG os_vif [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c1f0ee-95, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97e57f75-9e4f-4f8c-91e1-845efe7beb50) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:04 user nova-compute[75266]: INFO os_vif [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:50:ac,bridge_name='br-int',has_traffic_filtering=True,id=60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401,network=Network(17b52fdf-8b78-4226-b39e-12aa8c2e462a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1f0ee-95')
Nov 28 01:10:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Deleting instance files /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180_del
Nov 28 01:10:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Deletion of /opt/stack/data/nova/instances/7e025c3f-82f4-4b22-9429-50dd93b3b180_del complete
Nov 28 01:10:04 user nova-compute[75266]: INFO nova.compute.manager [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 01:10:04 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:10:04 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Took 0.70 seconds to deallocate network for instance.
Nov 28 01:10:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-deleted-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:05 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Deleted allocations for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Acquiring lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Lock "7e025c3f-82f4-4b22-9429-50dd93b3b180-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] No waiting events found dispatching network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:05 user nova-compute[75266]: WARNING nova.compute.manager [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Received unexpected event network-vif-plugged-60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance with vm_state deleted and task_state None.
Nov 28 01:10:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing instance network info cache due to event network-changed-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Acquiring lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Acquired lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG nova.network.neutron [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Refreshing network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:10 user nova-compute[75266]: INFO nova.compute.manager [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Terminating instance
Nov 28 01:10:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updated VIF entry in instance network info cache for port c9a1e437-bf6a-4ce6-a156-37a6e3d251d7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.network.neutron [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [{"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Releasing lock "refresh_cache-be9ab357-37c6-410c-919c-a144d4261ada" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Instance destroyed successfully.
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lazy-loading 'resources' on Instance uuid be9ab357-37c6-410c-919c-a144d4261ada {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-721476830',display_name='tempest-TestVolumeBootPattern-server-721476830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-721476830',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A==',key_name='tempest-TestVolumeBootPattern-832294225',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fd11e875f8544b495ef779a772b8a27',ramdisk_id='',reservation_id='r-b3ut2nd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156826038',owner_user_name='tempest-TestVolumeBootPattern-1156826038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:05:32Z,user_data=None,user_id='76463cfb4f9c4edd908a0dc57546bb3a',uuid=be9ab357-37c6-410c-919c-a144d4261ada,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converting VIF {"id": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "address": "fa:16:3e:aa:8d:5d", "network": {"id": "e7a9c673-be29-4f27-b00a-34793dbf68b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1031744886-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fd11e875f8544b495ef779a772b8a27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a1e437-bf", "ovs_interfaceid": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_vif [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9a1e437-bf, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aa3a183-bdf3-489b-87b4-9a6b46bc8d2d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:11 user nova-compute[75266]: INFO os_vif [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=c9a1e437-bf6a-4ce6-a156-37a6e3d251d7,network=Network(e7a9c673-be29-4f27-b00a-34793dbf68b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a1e437-bf')
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cVWLouDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:10:11 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803f1ee-b6ae-4dcc-b523-baee99732773]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:10:11 user nova-compute[75266]: No targets found.
Nov 28 01:10:11 user nova-compute[75266]: iSNS:
Nov 28 01:10:11 user nova-compute[75266]: No targets found.
Nov 28 01:10:11 user nova-compute[75266]: STATIC:
Nov 28 01:10:11 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e
Nov 28 01:10:11 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:10:11 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:10:11 user nova-compute[75266]: FIRMWARE:
Nov 28 01:10:11 user nova-compute[75266]: No targets found.
Nov 28 01:10:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:10:11 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:10:11 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1386e-6a5d-441f-a540-b5b2a7a5f6f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaecfad7-630d-4a05-a3fb-cd82e6782911]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:10:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e (non-flash)
Nov 28 01:10:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c5ee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efc90f-816f-4634-8771-3b48fe3f8221]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a0da8d-7dcd-4305-804e-908c9ab38a16]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3817937-17ec-4dc4-b42c-9148174e16e2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cacc5e-2c9e-44e2-89ad-3e6f539e8d24]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2ba7f947-0f39f2aab6236c9f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ba7f947', '/dev/disk/by-id/scsi-23066333966326161') {{(pid=86532) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[70865f1e-16da-4cf0-9129-bf7382dec9ca]: (4, None) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f9fdb1-6351-43fb-9dea-68bd4760874b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e10bd-d290-4a8c-ab57-61d4df0642e9]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260]
Nov 28 01:10:11 user nova-compute[75266]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e, portal: 172.16.0.220,3260] successful.
Nov 28 01:10:11 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570e5115-038a-4d98-a168-791774596b4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88a432-83a7-438a-b750-e222e318de36]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] <== disconnect_volume: return (332ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:10:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Deleting instance files /opt/stack/data/nova/instances/be9ab357-37c6-410c-919c-a144d4261ada_del
Nov 28 01:10:11 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Deletion of /opt/stack/data/nova/instances/be9ab357-37c6-410c-919c-a144d4261ada_del complete
Nov 28 01:10:11 user nova-compute[75266]: INFO nova.compute.manager [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 01:10:11 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:10:12 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Took 0.41 seconds to deallocate network for instance.
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-unplugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] No waiting events found dispatching network-vif-unplugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-unplugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Acquiring lock "be9ab357-37c6-410c-919c-a144d4261ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "be9ab357-37c6-410c-919c-a144d4261ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] No waiting events found dispatching network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:12 user nova-compute[75266]: WARNING nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received unexpected event network-vif-plugged-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance with vm_state active and task_state deleting.
Nov 28 01:10:12 user nova-compute[75266]: DEBUG nova.compute.manager [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Received event network-vif-deleted-c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:12 user nova-compute[75266]: INFO nova.compute.manager [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 01:10:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:13 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:10:13 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:10:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:13 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Deleted allocations for instance be9ab357-37c6-410c-919c-a144d4261ada
Nov 28 01:10:13 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "be9ab357-37c6-410c-919c-a144d4261ada" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:19 user nova-compute[75266]: INFO nova.compute.manager [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Terminating instance
Nov 28 01:10:19 user nova-compute[75266]: DEBUG nova.compute.manager [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.compute.manager [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-unplugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Instance destroyed successfully.
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'resources' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-630894117',display_name='tempest-ServerStableDeviceRescueTest-server-630894117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-630894117',id=42,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcFw9WNsB/WfF2yeONFBuXL4tVJCd6mCroGfOuvO/4DxlzDl5xxqNI0VkgQOtsTie1dnmO3kC91WgA34H9SFtyuAC+3yOr2ehde8YyilFwrcwTfGsSkIzwL3ui6imEtuQ==',key_name='tempest-keypair-1738700815',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc686f7daecb4843b4b0b4f1e89dec89',ramdisk_id='',reservation_id='r-7hyyosdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-109213497',owner_user_name='tempest-ServerStableDeviceRescueTest-109213497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e48c3f1b52e54c41b4499cbc2b767419',uuid=cb931a0c-8094-497e-a63b-676c763d5f44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converting VIF {"id": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "address": "fa:16:3e:af:12:7b", "network": {"id": "5e981df9-133f-43c2-bf2e-06e00574b620", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-292455023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc686f7daecb4843b4b0b4f1e89dec89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf2a135-0f", "ovs_interfaceid": "ebf2a135-0f75-4334-9e00-ee1e757402cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG os_vif [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf2a135-0f, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86657034-8ce6-4d06-b88f-b87011afb891) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:20 user nova-compute[75266]: INFO os_vif [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:12:7b,bridge_name='br-int',has_traffic_filtering=True,id=ebf2a135-0f75-4334-9e00-ee1e757402cc,network=Network(5e981df9-133f-43c2-bf2e-06e00574b620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf2a135-0f')
Nov 28 01:10:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Deleting instance files /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44_del
Nov 28 01:10:20 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Deletion of /opt/stack/data/nova/instances/cb931a0c-8094-497e-a63b-676c763d5f44_del complete
Nov 28 01:10:20 user nova-compute[75266]: INFO nova.compute.manager [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 01:10:20 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:10:20 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:10:21 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Took 0.67 seconds to deallocate network for instance.
Nov 28 01:10:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:10:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:21 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Deleted allocations for instance cb931a0c-8094-497e-a63b-676c763d5f44
Nov 28 01:10:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "cb931a0c-8094-497e-a63b-676c763d5f44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Acquiring lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Lock "cb931a0c-8094-497e-a63b-676c763d5f44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] No waiting events found dispatching network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:10:22 user nova-compute[75266]: WARNING nova.compute.manager [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received unexpected event network-vif-plugged-ebf2a135-0f75-4334-9e00-ee1e757402cc for instance with vm_state deleted and task_state None.
Nov 28 01:10:22 user nova-compute[75266]: DEBUG nova.compute.manager [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Received event network-vif-deleted-ebf2a135-0f75-4334-9e00-ee1e757402cc {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:10:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:10:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:10:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:10:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.127887725830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:10:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:10:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:10:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:10:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:10:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:10:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:10:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:10:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:11:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:11:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:11:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:11:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.11422348022461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:11:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:40 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:11:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:11:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:11:43 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:11:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:11:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:55 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:11:55 user nova-compute[75266]: INFO nova.compute.claims [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Claim successful on node user
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:11:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.policy [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:11:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Creating image(s)
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "/opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "/opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.203s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk 1073741824" returned: 0 in 0.051s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.197s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Successfully created port: 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Cannot resize image /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Successfully updated port: 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquired lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-changed-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.compute.manager [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Refreshing instance network info cache due to event network-changed-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Acquiring lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:11:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Releasing lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Instance network_info: |[{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Acquired lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Refreshing network info cache for port 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Start _get_guest_xml network_info=[{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:11:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:11:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-635438247',display_name='tempest-VolumesSnapshotTestJSON-instance-635438247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-635438247',id=48,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtYCWCDQuZb4DfC+SU6lFmR3Hw+VfcMeSDfs4mLyV9XIQewuB4DEh/RJDa5md+FZLJ1GtflCF+wZrmEDlinv6wQ8yqc/ZDj6UacHhypFflJEZbSEAc3EGIUaNoHCUqvQ==',key_name='tempest-keypair-1320549272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ulal2fvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=d4f08617-1de4-4ad2-8d6a-17a08873037b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:11:58 user nova-compute[75266]:   <uuid>d4f08617-1de4-4ad2-8d6a-17a08873037b</uuid>
Nov 28 01:11:58 user nova-compute[75266]:   <name>instance-00000030</name>
Nov 28 01:11:58 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:11:58 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:11:58 user nova-compute[75266]:   <metadata>
Nov 28 01:11:58 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:11:58 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-635438247</nova:name>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:11:58</nova:creationTime>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:11:58 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:11:58 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:owner>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:user uuid="90118ca36d3048568d1b1a1992a1408e">tempest-VolumesSnapshotTestJSON-1830776622-project-member</nova:user>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:project uuid="dda55c6e8fd645869a7530dcb9910b25">tempest-VolumesSnapshotTestJSON-1830776622</nova:project>
Nov 28 01:11:58 user nova-compute[75266]:       </nova:owner>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:11:58 user nova-compute[75266]:       <nova:ports>
Nov 28 01:11:58 user nova-compute[75266]:         <nova:port uuid="7bbf53e5-9795-4a4c-8a4b-3dfb0807845a">
Nov 28 01:11:58 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 01:11:58 user nova-compute[75266]:         </nova:port>
Nov 28 01:11:58 user nova-compute[75266]:       </nova:ports>
Nov 28 01:11:58 user nova-compute[75266]:     </nova:instance>
Nov 28 01:11:58 user nova-compute[75266]:   </metadata>
Nov 28 01:11:58 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:11:58 user nova-compute[75266]:     <system>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="serial">d4f08617-1de4-4ad2-8d6a-17a08873037b</entry>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="uuid">d4f08617-1de4-4ad2-8d6a-17a08873037b</entry>
Nov 28 01:11:58 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:11:58 user nova-compute[75266]:     </system>
Nov 28 01:11:58 user nova-compute[75266]:   </sysinfo>
Nov 28 01:11:58 user nova-compute[75266]:   <os>
Nov 28 01:11:58 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:11:58 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:11:58 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:11:58 user nova-compute[75266]:   </os>
Nov 28 01:11:58 user nova-compute[75266]:   <features>
Nov 28 01:11:58 user nova-compute[75266]:     <acpi/>
Nov 28 01:11:58 user nova-compute[75266]:     <apic/>
Nov 28 01:11:58 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:11:58 user nova-compute[75266]:   </features>
Nov 28 01:11:58 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:11:58 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:11:58 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:11:58 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:11:58 user nova-compute[75266]:   </clock>
Nov 28 01:11:58 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:11:58 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:11:58 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:11:58 user nova-compute[75266]:   </cpu>
Nov 28 01:11:58 user nova-compute[75266]:   <devices>
Nov 28 01:11:58 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:11:58 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:11:58 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk"/>
Nov 28 01:11:58 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:11:58 user nova-compute[75266]:     </disk>
Nov 28 01:11:58 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:11:58 user nova-compute[75266]:       <mac address="fa:16:3e:12:42:5b"/>
Nov 28 01:11:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:11:58 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:11:58 user nova-compute[75266]:       <target dev="tap7bbf53e5-97"/>
Nov 28 01:11:58 user nova-compute[75266]:     </interface>
Nov 28 01:11:58 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:11:58 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/console.log" append="off"/>
Nov 28 01:11:58 user nova-compute[75266]:     </serial>
Nov 28 01:11:58 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:11:58 user nova-compute[75266]:     <video>
Nov 28 01:11:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:11:58 user nova-compute[75266]:     </video>
Nov 28 01:11:58 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:11:58 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:11:58 user nova-compute[75266]:     </rng>
Nov 28 01:11:58 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:11:58 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:11:58 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:11:58 user nova-compute[75266]:     </memballoon>
Nov 28 01:11:58 user nova-compute[75266]:   </devices>
Nov 28 01:11:58 user nova-compute[75266]: </domain>
Nov 28 01:11:58 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-635438247',display_name='tempest-VolumesSnapshotTestJSON-instance-635438247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-635438247',id=48,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtYCWCDQuZb4DfC+SU6lFmR3Hw+VfcMeSDfs4mLyV9XIQewuB4DEh/RJDa5md+FZLJ1GtflCF+wZrmEDlinv6wQ8yqc/ZDj6UacHhypFflJEZbSEAc3EGIUaNoHCUqvQ==',key_name='tempest-keypair-1320549272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ulal2fvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=d4f08617-1de4-4ad2-8d6a-17a08873037b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG os_vif [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28cca495-52b6-5e16-8ae6-a4b84946be1d', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bbf53e5-97, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bbf53e5-97, col_values=(('qos', UUID('01449494-7709-45bd-9bda-b22cfbfb94be')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bbf53e5-97, col_values=(('external_ids', {'iface-id': '7bbf53e5-9795-4a4c-8a4b-3dfb0807845a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:42:5b', 'vm-uuid': 'd4f08617-1de4-4ad2-8d6a-17a08873037b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:58 user nova-compute[75266]: INFO os_vif [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97')
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No VIF found with MAC fa:16:3e:12:42:5b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updated VIF entry in instance network info cache for port 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:11:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Releasing lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:11:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:11:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] No waiting events found dispatching network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:12:00 user nova-compute[75266]: WARNING nova.compute.manager [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received unexpected event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance with vm_state building and task_state spawning.
Nov 28 01:12:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:12:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Instance spawned successfully.
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:12:02 user nova-compute[75266]: INFO nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:12:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] No waiting events found dispatching network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:12:02 user nova-compute[75266]: WARNING nova.compute.manager [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received unexpected event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance with vm_state building and task_state spawning.
Nov 28 01:12:02 user nova-compute[75266]: INFO nova.compute.manager [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Took 6.59 seconds to build instance.
Nov 28 01:12:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.760s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:12:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:34 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:12:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:12:38 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:12:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.080490112304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d4f08617-1de4-4ad2-8d6a-17a08873037b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:12:38 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:12:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:12:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:12:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:12:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:12:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:12:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:12:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:12:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:12:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:12:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:13:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:13:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:13:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:40 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:13:40 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.06954574584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance d4f08617-1de4-4ad2-8d6a-17a08873037b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:13:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:13:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-changed-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Refreshing instance network info cache due to event network-changed-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Acquiring lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Acquired lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.network.neutron [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Refreshing network info cache for port 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:13:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Ignoring supplied device name: /dev/vdb
Nov 28 01:13:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:47 user nova-compute[75266]: INFO nova.compute.manager [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Attaching volume 30325890-7723-4d78-b751-247876109c62 to /dev/vdb
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updated VIF entry in instance network info cache for port 7bbf53e5-9795-4a4c-8a4b-3dfb0807845a. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Releasing lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.utils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e12d3db-2b14-4407-a087-82af0e88c981]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d14c700-0608-4a11-97a5-6c32224337d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2df320-c8e7-4c49-b74d-f90aa1f2c77b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bfbb45-bba8-4dee-b085-01c39b279a8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:13:47 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d8e546-e174-4152-b1b0-a740deebb580]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG os_brick.utils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating existing volume attachment record: 181a59c6-b1b2-41e1-a2b7-af5e88735b92 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [{"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-d4f08617-1de4-4ad2-8d6a-17a08873037b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:13:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:13:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:50 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:13:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNeRUJQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:13:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:13:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:13:54 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab3d900-c2a7-4dc4-bdee-baa9eeb5fb10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:13:54 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0f799-3ba5-49fb-805b-f687c9b66a68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62] added
Nov 28 01:13:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1090d-820d-4194-a1d2-fbbd3be6c052]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ddd37-8ffb-47df-ba07-3acc0ab946b2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNeRUJQP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNeRUJQP" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14acc22-f0cc-4ebe-afe7-fdc5ce900604]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CNeRUJQP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aba5f2-c46a-4e67-9ce0-2be3aac0100d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fa7dd7-f745-497d-97f4-267baa38fc8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:13:54 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:13:54 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:13:54 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:13:54 user nova-compute[75266]: 
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f14c05-a679-463e-9e62-7d2b6e2b280c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260]
Nov 28 01:13:54 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260] successful.
Nov 28 01:13:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[269db30d-6bf3-48df-a014-598853e03476]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ee6ec6-beea-47ee-a34a-278f43061680]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)
Nov 28 01:13:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)
Nov 28 01:13:54 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1707e4ff-e38a-454b-b836-eba6b5cad484]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:13:54 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNeRUJQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:13:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:13:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26138623733646138', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:13:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623733646138', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:13:55 user nova-compute[75266]: DEBUG nova.objects.instance [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:13:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:13:55 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:13:55 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:13:55 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:13:55 user nova-compute[75266]:   <serial>30325890-7723-4d78-b751-247876109c62</serial>
Nov 28 01:13:55 user nova-compute[75266]: </disk>
Nov 28 01:13:55 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:13:56 user nova-compute[75266]: INFO nova.compute.claims [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Claim successful on node user
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No VIF found with MAC fa:16:3e:12:42:5b, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.547s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:13:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.policy [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:13:56 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Creating image(s)
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "/opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "/opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "/opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk 1073741824" returned: 0 in 0.066s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Successfully created port: 10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.189s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Cannot resize image /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Ensure instance console log exists: /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:13:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Successfully updated port: 10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquired lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-changed-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.compute.manager [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Refreshing instance network info cache due to event network-changed-10103dcb-bcfe-4b53-8292-b97019bca924. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Acquiring lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Releasing lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Instance network_info: |[{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Acquired lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Refreshing network info cache for port 10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Start _get_guest_xml network_info=[{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:13:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:13:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2085450450',display_name='tempest-TestServerVolumeAttachmentScenario-server-2085450450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2085450450',id=49,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyXFae5/hSKsUVk3ewdKKtsMGo31X5jvAUtG8xeOxMo40Qn7+oGIOR+89UCaISVyd5JDnlFxBVQ5RTQxG72sdQzKyXZhqjU/jef0RGyN1TrhGmJ9z7G9rknduVbN1Inog==',key_name='tempest-keypair-449884608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77e203bb29f74a8e8ef0b75bedbdbec3',ramdisk_id='',reservation_id='r-0fcaavb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-784605151',owner_user_name='tempest-TestServerVolumeAttachmentScenario-784605151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cef1d744ac594ab4a32a7355ddff4b8b',uuid=8104f3b0-49a7-4036-8ff6-56594ce3ee69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converting VIF {"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'pci_devices' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:13:58 user nova-compute[75266]:   <uuid>8104f3b0-49a7-4036-8ff6-56594ce3ee69</uuid>
Nov 28 01:13:58 user nova-compute[75266]:   <name>instance-00000031</name>
Nov 28 01:13:58 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:13:58 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:13:58 user nova-compute[75266]:   <metadata>
Nov 28 01:13:58 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:13:58 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2085450450</nova:name>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:13:58</nova:creationTime>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:13:58 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:13:58 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:owner>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:user uuid="cef1d744ac594ab4a32a7355ddff4b8b">tempest-TestServerVolumeAttachmentScenario-784605151-project-member</nova:user>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:project uuid="77e203bb29f74a8e8ef0b75bedbdbec3">tempest-TestServerVolumeAttachmentScenario-784605151</nova:project>
Nov 28 01:13:58 user nova-compute[75266]:       </nova:owner>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:13:58 user nova-compute[75266]:       <nova:ports>
Nov 28 01:13:58 user nova-compute[75266]:         <nova:port uuid="10103dcb-bcfe-4b53-8292-b97019bca924">
Nov 28 01:13:58 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 01:13:58 user nova-compute[75266]:         </nova:port>
Nov 28 01:13:58 user nova-compute[75266]:       </nova:ports>
Nov 28 01:13:58 user nova-compute[75266]:     </nova:instance>
Nov 28 01:13:58 user nova-compute[75266]:   </metadata>
Nov 28 01:13:58 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:13:58 user nova-compute[75266]:     <system>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="serial">8104f3b0-49a7-4036-8ff6-56594ce3ee69</entry>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="uuid">8104f3b0-49a7-4036-8ff6-56594ce3ee69</entry>
Nov 28 01:13:58 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:13:58 user nova-compute[75266]:     </system>
Nov 28 01:13:58 user nova-compute[75266]:   </sysinfo>
Nov 28 01:13:58 user nova-compute[75266]:   <os>
Nov 28 01:13:58 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:13:58 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:13:58 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:13:58 user nova-compute[75266]:   </os>
Nov 28 01:13:58 user nova-compute[75266]:   <features>
Nov 28 01:13:58 user nova-compute[75266]:     <acpi/>
Nov 28 01:13:58 user nova-compute[75266]:     <apic/>
Nov 28 01:13:58 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:13:58 user nova-compute[75266]:   </features>
Nov 28 01:13:58 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:13:58 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:13:58 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:13:58 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:13:58 user nova-compute[75266]:   </clock>
Nov 28 01:13:58 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:13:58 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:13:58 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:13:58 user nova-compute[75266]:   </cpu>
Nov 28 01:13:58 user nova-compute[75266]:   <devices>
Nov 28 01:13:58 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:13:58 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:13:58 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk"/>
Nov 28 01:13:58 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:13:58 user nova-compute[75266]:     </disk>
Nov 28 01:13:58 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:13:58 user nova-compute[75266]:       <mac address="fa:16:3e:f3:ea:96"/>
Nov 28 01:13:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:13:58 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:13:58 user nova-compute[75266]:       <target dev="tap10103dcb-bc"/>
Nov 28 01:13:58 user nova-compute[75266]:     </interface>
Nov 28 01:13:58 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:13:58 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/console.log" append="off"/>
Nov 28 01:13:58 user nova-compute[75266]:     </serial>
Nov 28 01:13:58 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:13:58 user nova-compute[75266]:     <video>
Nov 28 01:13:58 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:13:58 user nova-compute[75266]:     </video>
Nov 28 01:13:58 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:13:58 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:13:58 user nova-compute[75266]:     </rng>
Nov 28 01:13:58 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:13:58 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:13:58 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:13:58 user nova-compute[75266]:     </memballoon>
Nov 28 01:13:58 user nova-compute[75266]:   </devices>
Nov 28 01:13:58 user nova-compute[75266]: </domain>
Nov 28 01:13:58 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2085450450',display_name='tempest-TestServerVolumeAttachmentScenario-server-2085450450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2085450450',id=49,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyXFae5/hSKsUVk3ewdKKtsMGo31X5jvAUtG8xeOxMo40Qn7+oGIOR+89UCaISVyd5JDnlFxBVQ5RTQxG72sdQzKyXZhqjU/jef0RGyN1TrhGmJ9z7G9rknduVbN1Inog==',key_name='tempest-keypair-449884608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77e203bb29f74a8e8ef0b75bedbdbec3',ramdisk_id='',reservation_id='r-0fcaavb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-784605151',owner_user_name='tempest-TestServerVolumeAttachmentScenario-784605151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cef1d744ac594ab4a32a7355ddff4b8b',uuid=8104f3b0-49a7-4036-8ff6-56594ce3ee69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converting VIF {"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG os_vif [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29ab084a-d7fb-58e7-9c43-6c34a4c19ca5', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10103dcb-bc, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10103dcb-bc, col_values=(('qos', UUID('39997892-35c8-41c9-901d-92daec43c06d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10103dcb-bc, col_values=(('external_ids', {'iface-id': '10103dcb-bcfe-4b53-8292-b97019bca924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:ea:96', 'vm-uuid': '8104f3b0-49a7-4036-8ff6-56594ce3ee69'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:58 user nova-compute[75266]: INFO os_vif [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc')
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No VIF found with MAC fa:16:3e:f3:ea:96, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updated VIF entry in instance network info cache for port 10103dcb-bcfe-4b53-8292-b97019bca924. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG nova.network.neutron [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:13:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Releasing lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:13:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:13:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG nova.compute.manager [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] No waiting events found dispatching network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:14:00 user nova-compute[75266]: WARNING nova.compute.manager [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received unexpected event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 for instance with vm_state building and task_state spawning.
Nov 28 01:14:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:14:02 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Instance spawned successfully.
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.compute.manager [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] No waiting events found dispatching network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:14:02 user nova-compute[75266]: WARNING nova.compute.manager [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received unexpected event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 for instance with vm_state building and task_state spawning.
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:14:02 user nova-compute[75266]: INFO nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 28 01:14:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:14:02 user nova-compute[75266]: INFO nova.compute.manager [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Took 6.16 seconds to build instance.
Nov 28 01:14:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.250s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:14:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:16 user nova-compute[75266]: INFO nova.compute.manager [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Detaching volume 30325890-7723-4d78-b751-247876109c62
Nov 28 01:14:16 user nova-compute[75266]: INFO nova.virt.block_device [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Attempting to driver detach volume 30325890-7723-4d78-b751-247876109c62 from mountpoint /dev/vdb
Nov 28 01:14:16 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Attempting to detach device vdb from instance d4f08617-1de4-4ad2-8d6a-17a08873037b from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:14:16 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:14:16 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:14:16 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:14:16 user nova-compute[75266]:   <serial>30325890-7723-4d78-b751-247876109c62</serial>
Nov 28 01:14:16 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:14:16 user nova-compute[75266]: </disk>
Nov 28 01:14:16 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:14:16 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully detached device vdb from instance d4f08617-1de4-4ad2-8d6a-17a08873037b from the persistent domain config.
Nov 28 01:14:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f08617-1de4-4ad2-8d6a-17a08873037b from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:14:16 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:14:16 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:14:16 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:14:16 user nova-compute[75266]:   <serial>30325890-7723-4d78-b751-247876109c62</serial>
Nov 28 01:14:16 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:14:16 user nova-compute[75266]: </disk>
Nov 28 01:14:16 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:14:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:17 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:14:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:37 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4f08617-1de4-4ad2-8d6a-17a08873037b is timed out.
Nov 28 01:14:37 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully detached device vdb from instance d4f08617-1de4-4ad2-8d6a-17a08873037b from the live domain config.
Nov 28 01:14:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNeRUJQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:14:37 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3096e1-b41b-4a39-a533-c0148a9ab3e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:14:37 user nova-compute[75266]: No targets found.
Nov 28 01:14:37 user nova-compute[75266]: iSNS:
Nov 28 01:14:37 user nova-compute[75266]: No targets found.
Nov 28 01:14:37 user nova-compute[75266]: STATIC:
Nov 28 01:14:37 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62
Nov 28 01:14:37 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:14:37 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:14:37 user nova-compute[75266]: FIRMWARE:
Nov 28 01:14:37 user nova-compute[75266]: No targets found.
Nov 28 01:14:37 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:14:37 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:14:37 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c99b8-e8be-40a3-a936-fb8fcc6bd6e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a3dbc-cf2f-4424-8e13-4b04371ba197]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)
Nov 28 01:14:37 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 (non-flash)
Nov 28 01:14:37 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c57e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385b61e-41b2-45bb-8598-c2ee32858d56]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7c57a-a868-49ee-a425-81d60c3c32d8]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573c92b-b2a5-4265-af87-e105a99140fa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[02851c4c-ff4b-4880-8cb2-ab83e05e070c]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[afddef1f-4bdf-44ff-b08f-965c6ebfc023]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e393508-e4bb-4f84-a025-a56ced276b41]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260]
Nov 28 01:14:37 user nova-compute[75266]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62, portal: 172.16.0.220,3260] successful.
Nov 28 01:14:37 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7583d5-8e46-4798-8d1e-5b0c4603527d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== disconnect_volume: return (302ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:14:37 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.objects.instance [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.553s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:38 user nova-compute[75266]: INFO nova.compute.manager [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Terminating instance
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-unplugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] No waiting events found dispatching network-vif-unplugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-unplugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Instance destroyed successfully.
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.objects.instance [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'resources' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-635438247',display_name='tempest-VolumesSnapshotTestJSON-instance-635438247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-635438247',id=48,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtYCWCDQuZb4DfC+SU6lFmR3Hw+VfcMeSDfs4mLyV9XIQewuB4DEh/RJDa5md+FZLJ1GtflCF+wZrmEDlinv6wQ8yqc/ZDj6UacHhypFflJEZbSEAc3EGIUaNoHCUqvQ==',key_name='tempest-keypair-1320549272',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ulal2fvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=d4f08617-1de4-4ad2-8d6a-17a08873037b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "address": "fa:16:3e:12:42:5b", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbf53e5-97", "ovs_interfaceid": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:14:38 user nova-compute[75266]: DEBUG os_vif [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bbf53e5-97, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01449494-7709-45bd-9bda-b22cfbfb94be) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:14:39 user nova-compute[75266]: INFO os_vif [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:5b,bridge_name='br-int',has_traffic_filtering=True,id=7bbf53e5-9795-4a4c-8a4b-3dfb0807845a,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbf53e5-97')
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:30325890-7723-4d78-b751-247876109c62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNeRUJQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:14:39 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[681a4695-a086-452f-9db9-a88057286e18]: Unexpected error while running command.
Nov 28 01:14:39 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:14:39 user nova-compute[75266]: Exit code: 21
Nov 28 01:14:39 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:14:39 user nova-compute[75266]: Stderr: '' {{(pid=86532) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 28 01:14:39 user nova-compute[75266]: Traceback (most recent call last):
Nov 28 01:14:39 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 28 01:14:39 user nova-compute[75266]:     ret = func(*f_args, **f_kwargs)
Nov 28 01:14:39 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 28 01:14:39 user nova-compute[75266]:     return func(*args, **kwargs)
Nov 28 01:14:39 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 28 01:14:39 user nova-compute[75266]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 28 01:14:39 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 28 01:14:39 user nova-compute[75266]:     return putils.execute(on_execute=on_execute,
Nov 28 01:14:39 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 28 01:14:39 user nova-compute[75266]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 28 01:14:39 user nova-compute[75266]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:14:39 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:14:39 user nova-compute[75266]: Exit code: 21
Nov 28 01:14:39 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:14:39 user nova-compute[75266]: Stderr: ''
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a4695-a086-452f-9db9-a88057286e18]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:14:39 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:14:39 user nova-compute[75266]: Exit code: 21
Nov 28 01:14:39 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:14:39 user nova-compute[75266]: Stderr: ''
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 28 01:14:39 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi 
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75266) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== disconnect_volume: return (37ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:14:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Deleting instance files /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b_del
Nov 28 01:14:39 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Deletion of /opt/stack/data/nova/instances/d4f08617-1de4-4ad2-8d6a-17a08873037b_del complete
Nov 28 01:14:39 user nova-compute[75266]: INFO nova.compute.manager [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:14:39 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Took 0.68 seconds to deallocate network for instance.
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-deleted-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:14:39 user nova-compute[75266]: WARNING nova.volume.cinder [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Attachment 181a59c6-b1b2-41e1-a2b7-af5e88735b92 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 181a59c6-b1b2-41e1-a2b7-af5e88735b92. (HTTP 404) (Request-ID: req-d21d220b-d557-4a34-9412-b7795b1a5f49)
Nov 28 01:14:39 user nova-compute[75266]: INFO nova.compute.manager [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Took 0.02 seconds to detach 1 volumes for instance.
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:39 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:40 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Deleted allocations for instance d4f08617-1de4-4ad2-8d6a-17a08873037b
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Acquiring lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Lock "d4f08617-1de4-4ad2-8d6a-17a08873037b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] No waiting events found dispatching network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:14:40 user nova-compute[75266]: WARNING nova.compute.manager [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Received unexpected event network-vif-plugged-7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance with vm_state deleted and task_state None.
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:40 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:14:41 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:14:41 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=25.066078186035156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:14:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:14:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:42 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:14:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:14:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:14:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:14:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:14:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:14:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:14:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:14:54 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:14:59 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:04 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:09 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:14 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:19 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:15:23 user nova-compute[75266]: INFO nova.compute.claims [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Claim successful on node user
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:15:23 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:15:23 user nova-compute[75266]: DEBUG nova.policy [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:15:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Creating image(s)
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "/opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "/opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "/opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk 1073741824" returned: 0 in 0.046s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.199s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Successfully created port: f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Cannot resize image /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Ensure instance console log exists: /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Successfully updated port: f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquired lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-changed-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Refreshing instance network info cache due to event network-changed-f710a167-ab3b-4a35-8cf0-406177b5dc4d. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Acquiring lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating instance_info_cache with network_info: [{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Releasing lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Instance network_info: |[{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Acquired lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.network.neutron [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Refreshing network info cache for port f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:15:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Start _get_guest_xml network_info=[{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:15:25 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:15:25 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119539314',display_name='tempest-VolumesSnapshotTestJSON-instance-119539314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119539314',id=50,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpj2ahpkdCQ15cwkZMGch7JSD/r+/zmDjn1oN/gdKB8QXyI/CtT+qDM4lvGU4UDdbgh1DCRIdfmtyUre1w1/T79WC4lZzfzqtiICT8xSNmO6QPGEZ+eyUMa2FSy/6VZyQ==',key_name='tempest-keypair-2005613057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ig3g4ml8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=07b6bc44-64e6-4137-9046-4440e8274e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'pci_devices' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:15:26 user nova-compute[75266]:   <uuid>07b6bc44-64e6-4137-9046-4440e8274e07</uuid>
Nov 28 01:15:26 user nova-compute[75266]:   <name>instance-00000032</name>
Nov 28 01:15:26 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:15:26 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:15:26 user nova-compute[75266]:   <metadata>
Nov 28 01:15:26 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:15:26 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-119539314</nova:name>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:15:25</nova:creationTime>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:15:26 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:15:26 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:owner>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:user uuid="90118ca36d3048568d1b1a1992a1408e">tempest-VolumesSnapshotTestJSON-1830776622-project-member</nova:user>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:project uuid="dda55c6e8fd645869a7530dcb9910b25">tempest-VolumesSnapshotTestJSON-1830776622</nova:project>
Nov 28 01:15:26 user nova-compute[75266]:       </nova:owner>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:15:26 user nova-compute[75266]:       <nova:ports>
Nov 28 01:15:26 user nova-compute[75266]:         <nova:port uuid="f710a167-ab3b-4a35-8cf0-406177b5dc4d">
Nov 28 01:15:26 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 01:15:26 user nova-compute[75266]:         </nova:port>
Nov 28 01:15:26 user nova-compute[75266]:       </nova:ports>
Nov 28 01:15:26 user nova-compute[75266]:     </nova:instance>
Nov 28 01:15:26 user nova-compute[75266]:   </metadata>
Nov 28 01:15:26 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:15:26 user nova-compute[75266]:     <system>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="serial">07b6bc44-64e6-4137-9046-4440e8274e07</entry>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="uuid">07b6bc44-64e6-4137-9046-4440e8274e07</entry>
Nov 28 01:15:26 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:15:26 user nova-compute[75266]:     </system>
Nov 28 01:15:26 user nova-compute[75266]:   </sysinfo>
Nov 28 01:15:26 user nova-compute[75266]:   <os>
Nov 28 01:15:26 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:15:26 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:15:26 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:15:26 user nova-compute[75266]:   </os>
Nov 28 01:15:26 user nova-compute[75266]:   <features>
Nov 28 01:15:26 user nova-compute[75266]:     <acpi/>
Nov 28 01:15:26 user nova-compute[75266]:     <apic/>
Nov 28 01:15:26 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:15:26 user nova-compute[75266]:   </features>
Nov 28 01:15:26 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:15:26 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:15:26 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:15:26 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:15:26 user nova-compute[75266]:   </clock>
Nov 28 01:15:26 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:15:26 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:15:26 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:15:26 user nova-compute[75266]:   </cpu>
Nov 28 01:15:26 user nova-compute[75266]:   <devices>
Nov 28 01:15:26 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:15:26 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:15:26 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk"/>
Nov 28 01:15:26 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:15:26 user nova-compute[75266]:     </disk>
Nov 28 01:15:26 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:15:26 user nova-compute[75266]:       <mac address="fa:16:3e:51:66:ef"/>
Nov 28 01:15:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:15:26 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:15:26 user nova-compute[75266]:       <target dev="tapf710a167-ab"/>
Nov 28 01:15:26 user nova-compute[75266]:     </interface>
Nov 28 01:15:26 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:15:26 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/console.log" append="off"/>
Nov 28 01:15:26 user nova-compute[75266]:     </serial>
Nov 28 01:15:26 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:15:26 user nova-compute[75266]:     <video>
Nov 28 01:15:26 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:15:26 user nova-compute[75266]:     </video>
Nov 28 01:15:26 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:15:26 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:15:26 user nova-compute[75266]:     </rng>
Nov 28 01:15:26 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:15:26 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:15:26 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:15:26 user nova-compute[75266]:     </memballoon>
Nov 28 01:15:26 user nova-compute[75266]:   </devices>
Nov 28 01:15:26 user nova-compute[75266]: </domain>
Nov 28 01:15:26 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119539314',display_name='tempest-VolumesSnapshotTestJSON-instance-119539314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119539314',id=50,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpj2ahpkdCQ15cwkZMGch7JSD/r+/zmDjn1oN/gdKB8QXyI/CtT+qDM4lvGU4UDdbgh1DCRIdfmtyUre1w1/T79WC4lZzfzqtiICT8xSNmO6QPGEZ+eyUMa2FSy/6VZyQ==',key_name='tempest-keypair-2005613057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ig3g4ml8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=07b6bc44-64e6-4137-9046-4440e8274e07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG os_vif [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad6ac408-9b8b-5bd7-b9f1-329dd64d63de', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf710a167-ab, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf710a167-ab, col_values=(('qos', UUID('8f312100-4d1c-4e2a-8a44-b959a177dc0e')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf710a167-ab, col_values=(('external_ids', {'iface-id': 'f710a167-ab3b-4a35-8cf0-406177b5dc4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:66:ef', 'vm-uuid': '07b6bc44-64e6-4137-9046-4440e8274e07'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:26 user nova-compute[75266]: INFO os_vif [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab')
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No VIF found with MAC fa:16:3e:51:66:ef, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.neutron [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updated VIF entry in instance network info cache for port f710a167-ab3b-4a35-8cf0-406177b5dc4d. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG nova.network.neutron [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating instance_info_cache with network_info: [{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:15:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Releasing lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] No waiting events found dispatching network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:15:27 user nova-compute[75266]: WARNING nova.compute.manager [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received unexpected event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance with vm_state building and task_state spawning.
Nov 28 01:15:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.compute.manager [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.compute.manager [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] No waiting events found dispatching network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:15:29 user nova-compute[75266]: WARNING nova.compute.manager [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received unexpected event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance with vm_state building and task_state spawning.
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:15:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Instance spawned successfully.
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:15:29 user nova-compute[75266]: INFO nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 28 01:15:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:15:30 user nova-compute[75266]: INFO nova.compute.manager [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Took 6.39 seconds to build instance.
Nov 28 01:15:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.488s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:36 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:15:42 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:15:42 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.056060791015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 07b6bc44-64e6-4137-9046-4440e8274e07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:15:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:44 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:15:45 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-changed-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Refreshing instance network info cache due to event network-changed-10103dcb-bcfe-4b53-8292-b97019bca924. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Acquiring lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Acquired lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Refreshing network info cache for port 10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updated VIF entry in instance network info cache for port 10103dcb-bcfe-4b53-8292-b97019bca924. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.network.neutron [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Releasing lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:47 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.222s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:15:48 user nova-compute[75266]: INFO nova.compute.manager [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attaching volume e6b45b4f-d69c-4017-bba8-60618133ff2c to /dev/vdb
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.utils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f9b2be-0d4e-4d41-a610-579dad4da976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0562eaa5-bdf3-44b5-a654-01c22d402c4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[227389aa-6947-4738-bf3c-ec65bf8cf5e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1185b3-c107-443c-8966-a2cd56ba4786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:15:48 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[880abac7-f707-4c23-b5b4-179a58a96bb8]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG os_brick.utils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating existing volume attachment record: 8b0e3118-4135-4b49-84de-3c2b3665fc03 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:15:48 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:15:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [{"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:15:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8104f3b0-49a7-4036-8ff6-56594ce3ee69" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:15:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:15:50 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:15:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YToBuzsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:15:55 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:15:55 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:15:55 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09fa10-5c2d-475e-a0eb-c29716642408]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:15:55 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0210d5-6b89-4246-ae43-99a0eb7c5aa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c] added
Nov 28 01:15:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bec45-ffed-41f4-82f1-d28321433af2]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4056b6f5-5b18-4f8a-b77c-98fa851a6eee]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YToBuzsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YToBuzsi" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5592a8c8-effc-45ce-b707-fb6cdf373515]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YToBuzsi'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d7cb9-f263-4f16-b4ed-4221caf97521]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2ff553-2159-422f-90ac-dea29facdd05]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:15:55 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:15:55 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:15:55 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:15:55 user nova-compute[75266]: 
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd301a20-7086-491c-8ba0-cb675ce37dee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260]
Nov 28 01:15:55 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260] successful.
Nov 28 01:15:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84e69b-949e-44ba-a004-978019228f54]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cfcc01-1b46-4bdd-baca-c4cdb74ac08f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:15:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:15:55 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e7cc3-73c0-4697-b2af-b347f9691b91]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:15:55 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YToBuzsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23939613535383361', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939613535383361', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:15:56 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:15:56 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:15:56 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:15:56 user nova-compute[75266]:   <serial>e6b45b4f-d69c-4017-bba8-60618133ff2c</serial>
Nov 28 01:15:56 user nova-compute[75266]: </disk>
Nov 28 01:15:56 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No VIF found with MAC fa:16:3e:f3:ea:96, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:15:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.601s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:16:00 user nova-compute[75266]: INFO nova.compute.manager [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attaching volume ca52e32c-89b6-4397-ba77-916568ea2228 to /dev/vdc
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efa30e-7bbf-4bed-8c3e-914b56314dde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeeefd2-cc51-4137-807d-df177fc42dc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d6fc16-fa60-46b6-b27c-014b4acdd6fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7053527f-bd07-491b-97bf-df8cb8a0b44d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:16:00 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:16:00 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e666e-619c-4449-a4ca-41fd9477d7bc]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG os_brick.utils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:16:00 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating existing volume attachment record: d089d72a-6e3b-41b5-a96c-c42a697273ba {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:16:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOBtGiMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:16:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:16:07 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:16:07 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547e9e9-7a65-49dc-88d5-2fdcb2b4daf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:16:07 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d334b8e4-2ba7-4198-a158-7239e5a5d4f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228] added
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c293597-caf8-4b69-a73b-8a75f9fd2043]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2a5a5-9257-41ea-a029-d4e4e925d1cf]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOBtGiMj {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOBtGiMj" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc5ab3-36e8-4645-b337-e7f7d9158d5a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOBtGiMj'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb47074-66b3-4223-9df4-16c470314316]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7b71d-2be6-4c12-9815-716cdede19b7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e2a63-1710-49a4-bc69-bb16813df509]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260]
Nov 28 01:16:07 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260] successful.
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22658c-6bd5-4fdc-9264-cfff89e720dc]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5da31-560c-4a52-9583-b261671636a7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:07 user nova-compute[75266]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:07 user nova-compute[75266]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)
Nov 28 01:16:07 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe43ff-aba9-48ec-b194-48fcd229e566]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:16:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOBtGiMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:16:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:16:08 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23535346564333430', 'path': '/dev/sdc'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:16:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535346564333430', 'path': '/dev/sdc'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:16:08 user nova-compute[75266]: DEBUG nova.objects.instance [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:16:08 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:16:08 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:16:08 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 01:16:08 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 01:16:08 user nova-compute[75266]:   <serial>ca52e32c-89b6-4397-ba77-916568ea2228</serial>
Nov 28 01:16:08 user nova-compute[75266]: </disk>
Nov 28 01:16:08 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:16:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:16:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:16:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:16:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] No VIF found with MAC fa:16:3e:f3:ea:96, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:16:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.811s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:16:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:16:10 user nova-compute[75266]: INFO nova.compute.manager [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Detaching volume ca52e32c-89b6-4397-ba77-916568ea2228
Nov 28 01:16:10 user nova-compute[75266]: INFO nova.virt.block_device [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attempting to driver detach volume ca52e32c-89b6-4397-ba77-916568ea2228 from mountpoint /dev/vdc
Nov 28 01:16:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Attempting to detach device vdc from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:16:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:16:10 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:16:10 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 01:16:10 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 01:16:10 user nova-compute[75266]:   <serial>ca52e32c-89b6-4397-ba77-916568ea2228</serial>
Nov 28 01:16:10 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 01:16:10 user nova-compute[75266]: </disk>
Nov 28 01:16:10 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:16:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully detached device vdc from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the persistent domain config.
Nov 28 01:16:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:16:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:16:10 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:16:10 user nova-compute[75266]:   <source dev="/dev/sdc"/>
Nov 28 01:16:10 user nova-compute[75266]:   <target dev="vdc" bus="virtio"/>
Nov 28 01:16:10 user nova-compute[75266]:   <serial>ca52e32c-89b6-4397-ba77-916568ea2228</serial>
Nov 28 01:16:10 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 01:16:10 user nova-compute[75266]: </disk>
Nov 28 01:16:10 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:16:11 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:16:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is timed out.
Nov 28 01:16:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully detached device vdc from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the live domain config.
Nov 28 01:16:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOBtGiMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:16:31 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55e902-7ea0-4ada-a823-a135970a310b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:16:31 user nova-compute[75266]: No targets found.
Nov 28 01:16:31 user nova-compute[75266]: iSNS:
Nov 28 01:16:31 user nova-compute[75266]: No targets found.
Nov 28 01:16:31 user nova-compute[75266]: STATIC:
Nov 28 01:16:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228
Nov 28 01:16:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:16:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:16:31 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c
Nov 28 01:16:31 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:16:31 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:16:31 user nova-compute[75266]: FIRMWARE:
Nov 28 01:16:31 user nova-compute[75266]: No targets found.
Nov 28 01:16:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:16:31 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:16:31 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908d0a2-c409-47db-85e5-f58bded9356b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b691c4-b991-419c-af89-15227aea92c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:31 user nova-compute[75266]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)
Nov 28 01:16:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:16:31 user nova-compute[75266]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 (non-flash)
Nov 28 01:16:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c240280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228'): ({'sdc'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Removing single pathed devices sdc {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[170cddf6-ce27-4a6f-aeb3-e21e937c3151]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9e88d-405e-403e-ae75-138b3e2ecea1]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flushing IO for device /dev/sdc {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b397c4-0bf0-43c9-b950-9d605f90be61]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3271c-dfe9-44ac-aa82-04be07ece903]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] SCSI volumes sdc have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90fa3d-5879-40b1-8cc0-44a4542f07e0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887a48a-518f-4e7a-a5ee-9ad627200a21]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260]
Nov 28 01:16:31 user nova-compute[75266]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228, portal: 172.16.0.220,3260] successful.
Nov 28 01:16:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca52e32c-89b6-4397-ba77-916568ea2228 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9df64-1d13-42d6-833e-19f42ab29296]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== disconnect_volume: return (314ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:16:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:16:32 user nova-compute[75266]: DEBUG nova.objects.instance [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:16:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:38 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:16:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:16:44 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:16:44 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:16:44 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.02667999267578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:16:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 07b6bc44-64e6-4137-9046-4440e8274e07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:16:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:16:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:16:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:16:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:16:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:16:49 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:16:50 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating instance_info_cache with network_info: [{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:16:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:16:50 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:16:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:16:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:16:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:00 user nova-compute[75266]: INFO nova.compute.manager [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Detaching volume e6b45b4f-d69c-4017-bba8-60618133ff2c
Nov 28 01:17:01 user nova-compute[75266]: INFO nova.virt.block_device [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Attempting to driver detach volume e6b45b4f-d69c-4017-bba8-60618133ff2c from mountpoint /dev/vdb
Nov 28 01:17:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Attempting to detach device vdb from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:17:01 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:17:01 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:17:01 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:17:01 user nova-compute[75266]:   <serial>e6b45b4f-d69c-4017-bba8-60618133ff2c</serial>
Nov 28 01:17:01 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:17:01 user nova-compute[75266]: </disk>
Nov 28 01:17:01 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:17:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully detached device vdb from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the persistent domain config.
Nov 28 01:17:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:17:01 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:17:01 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:17:01 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:17:01 user nova-compute[75266]:   <serial>e6b45b4f-d69c-4017-bba8-60618133ff2c</serial>
Nov 28 01:17:01 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:17:01 user nova-compute[75266]: </disk>
Nov 28 01:17:01 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:17:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Verify base images {{(pid=75266) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Image id 0eca691f-8ae7-4ede-a543-e4f526783da7 yields fingerprint 09ab84a414a0d584125ec4a73a3925f0f0cda822 {{(pid=75266) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 01:17:09 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] image 0eca691f-8ae7-4ede-a543-e4f526783da7 at (/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822): checking
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] image 0eca691f-8ae7-4ede-a543-e4f526783da7 at (/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822): image is in use {{(pid=75266) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75266) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is a valid instance name {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] 8104f3b0-49a7-4036-8ff6-56594ce3ee69 has a disk file {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is backed by 09ab84a414a0d584125ec4a73a3925f0f0cda822 {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] 07b6bc44-64e6-4137-9046-4440e8274e07 is a valid instance name {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] 07b6bc44-64e6-4137-9046-4440e8274e07 has a disk file {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 01:17:09 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:10 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 07b6bc44-64e6-4137-9046-4440e8274e07 is backed by 09ab84a414a0d584125ec4a73a3925f0f0cda822 {{(pid=75266) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370
Nov 28 01:17:10 user nova-compute[75266]: WARNING nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Active base files: /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Removable base files: /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4 /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77 /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370 /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82b683c346e83b08986361bdba655fb5dfcac0e4
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b779762ea52d21917ae2ac7b70b26dfdfd6e79d
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7a77957f66666c43b161b69529db97d8fd05a5ba
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/995751a641a9823f519397bbc6e878aa85bc1a77
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2741bc359eefe7f2777b238327271256d49acb2a
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/356a732f6a30dbdea6c7fd7c4f7d05a6e4a0d370
Nov 28 01:17:10 user nova-compute[75266]: INFO nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/76f54b9a5402b8fe11e384a959e6a9f25c619162
Nov 28 01:17:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Verification complete {{(pid=75266) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 01:17:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Verify swap images {{(pid=75266) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 01:17:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.imagecache [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Verify ephemeral images {{(pid=75266) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 01:17:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-changed-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.compute.manager [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Refreshing instance network info cache due to event network-changed-f710a167-ab3b-4a35-8cf0-406177b5dc4d. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Acquiring lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Acquired lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Refreshing network info cache for port f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:17:14 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Ignoring supplied device name: /dev/vdb
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updated VIF entry in instance network info cache for port f710a167-ab3b-4a35-8cf0-406177b5dc4d. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG nova.network.neutron [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating instance_info_cache with network_info: [{"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Releasing lock "refresh_cache-07b6bc44-64e6-4137-9046-4440e8274e07" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:14 user nova-compute[75266]: INFO nova.compute.manager [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Attaching volume 9df0213b-c844-4e5c-a2d3-eac2005b2178 to /dev/vdb
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.utils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f96a1f6-8653-49a7-81cf-56ae63613394]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[412254cb-7c68-48e6-aa1e-5e148fa58f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d3e6ea-0229-4b05-8091-e0446e8e0d47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de50a71-0178-4be3-812a-6cb4e85451a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:17:15 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:17:15 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c30f7-42aa-4382-836b-58873bb696ce]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG os_brick.utils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:17:15 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating existing volume attachment record: a3e27bec-ae9d-4b06-948f-991f46a49452 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:17:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:21 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is timed out.
Nov 28 01:17:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully detached device vdb from instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 from the live domain config.
Nov 28 01:17:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YToBuzsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:17:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baea107-abc9-4a5e-b189-cd93087776f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:17:21 user nova-compute[75266]: No targets found.
Nov 28 01:17:21 user nova-compute[75266]: iSNS:
Nov 28 01:17:21 user nova-compute[75266]: No targets found.
Nov 28 01:17:21 user nova-compute[75266]: STATIC:
Nov 28 01:17:21 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c
Nov 28 01:17:21 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:17:21 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:17:21 user nova-compute[75266]: FIRMWARE:
Nov 28 01:17:21 user nova-compute[75266]: No targets found.
Nov 28 01:17:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:17:21 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:17:21 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a4a756-0738-4393-b488-e6025fbf05b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f2a1e-e617-4b27-b30b-43604d680dea]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:17:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c (non-flash)
Nov 28 01:17:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c340dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889b0ae-35fa-4d45-8127-8529712ddd18]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091d3d9-4bd4-47cf-9f56-2f117c2b592f]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b930b-24d4-4ad5-88d5-17181771ebb1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[437851b4-086f-40cf-8769-f435e4c7f6e8]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d01d81-cbb7-403d-a637-4611cdc6dbc9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYRoJxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:17:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b7800a-8ee4-4315-bfab-b009c3ddc87f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260]
Nov 28 01:17:21 user nova-compute[75266]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c, portal: 172.16.0.220,3260] successful.
Nov 28 01:17:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6b45b4f-d69c-4017-bba8-60618133ff2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3b8b4-2b58-4e5d-9f3f-94698802cb8e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] <== disconnect_volume: return (282ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.058s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:17:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:17:21 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9843dcb-9faa-45df-a6b3-6347e9a6b9a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:17:21 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed2eaf-92b1-43c8-83ee-13443d89aed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178] added
Nov 28 01:17:21 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601eb74-088d-48da-9ee7-f67e89a9a3dd]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[08989347-cf37-418e-a02e-bd46ace59ec9]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYRoJxul {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYRoJxul" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d5386-68ce-4ce3-9fc8-b0ae514a8605]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYRoJxul'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[35faaec2-5fc9-4437-bfb9-cb9cac77c4a4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[42335bd0-719f-422b-a179-3597a41a692d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:17:21 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:17:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:17:21 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:17:21 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:17:21 user nova-compute[75266]: 
Nov 28 01:17:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df58a15-2e8f-46a4-8f6a-1d6c42194ead]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260]
Nov 28 01:17:22 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260] successful.
Nov 28 01:17:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7321fe56-a599-47b4-b02d-aa21bd7a1587]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df2e67-33d6-446b-b8ff-9d9683ad79bf]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)
Nov 28 01:17:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)
Nov 28 01:17:22 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704cb47-5056-403e-9189-e7e60e14a957]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYRoJxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'flavor' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:17:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23631373531623032', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631373531623032', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.objects.instance [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:17:23 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:17:23 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:17:23 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:17:23 user nova-compute[75266]:   <serial>9df0213b-c844-4e5c-a2d3-eac2005b2178</serial>
Nov 28 01:17:23 user nova-compute[75266]: </disk>
Nov 28 01:17:23 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] No VIF found with MAC fa:16:3e:51:66:ef, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:17:23 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.711s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:41 user nova-compute[75266]: INFO nova.compute.manager [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Detaching volume 9df0213b-c844-4e5c-a2d3-eac2005b2178
Nov 28 01:17:41 user nova-compute[75266]: INFO nova.virt.block_device [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Attempting to driver detach volume 9df0213b-c844-4e5c-a2d3-eac2005b2178 from mountpoint /dev/vdb
Nov 28 01:17:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Attempting to detach device vdb from instance 07b6bc44-64e6-4137-9046-4440e8274e07 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:17:41 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:17:41 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:17:41 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:17:41 user nova-compute[75266]:   <serial>9df0213b-c844-4e5c-a2d3-eac2005b2178</serial>
Nov 28 01:17:41 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:17:41 user nova-compute[75266]: </disk>
Nov 28 01:17:41 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:17:41 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully detached device vdb from instance 07b6bc44-64e6-4137-9046-4440e8274e07 from the persistent domain config.
Nov 28 01:17:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07b6bc44-64e6-4137-9046-4440e8274e07 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:17:41 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:17:41 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:17:41 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:17:41 user nova-compute[75266]:   <serial>9df0213b-c844-4e5c-a2d3-eac2005b2178</serial>
Nov 28 01:17:41 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:17:41 user nova-compute[75266]: </disk>
Nov 28 01:17:41 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:43 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:17:44 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:17:44 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:17:44 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.02533721923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 07b6bc44-64e6-4137-9046-4440e8274e07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:17:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:17:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:51 user nova-compute[75266]: INFO nova.compute.manager [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Terminating instance
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-unplugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] No waiting events found dispatching network-vif-unplugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-unplugged-10103dcb-bcfe-4b53-8292-b97019bca924 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Skipping network cache update for instance because it is being deleted. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Skipping network cache update for instance because it is being deleted. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:17:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Instance destroyed successfully.
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.objects.instance [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'resources' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2085450450',display_name='tempest-TestServerVolumeAttachmentScenario-server-2085450450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2085450450',id=49,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyXFae5/hSKsUVk3ewdKKtsMGo31X5jvAUtG8xeOxMo40Qn7+oGIOR+89UCaISVyd5JDnlFxBVQ5RTQxG72sdQzKyXZhqjU/jef0RGyN1TrhGmJ9z7G9rknduVbN1Inog==',key_name='tempest-keypair-449884608',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77e203bb29f74a8e8ef0b75bedbdbec3',ramdisk_id='',reservation_id='r-0fcaavb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-784605151',owner_user_name='tempest-TestServerVolumeAttachmentScenario-784605151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cef1d744ac594ab4a32a7355ddff4b8b',uuid=8104f3b0-49a7-4036-8ff6-56594ce3ee69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converting VIF {"id": "10103dcb-bcfe-4b53-8292-b97019bca924", "address": "fa:16:3e:f3:ea:96", "network": {"id": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1918856940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77e203bb29f74a8e8ef0b75bedbdbec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10103dcb-bc", "ovs_interfaceid": "10103dcb-bcfe-4b53-8292-b97019bca924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG os_vif [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10103dcb-bc, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39997892-35c8-41c9-901d-92daec43c06d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:17:52 user nova-compute[75266]: INFO os_vif [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=10103dcb-bcfe-4b53-8292-b97019bca924,network=Network(20ad1c0d-5631-4468-8686-4ff9af7eb6ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10103dcb-bc')
Nov 28 01:17:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Deleting instance files /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69_del
Nov 28 01:17:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Deletion of /opt/stack/data/nova/instances/8104f3b0-49a7-4036-8ff6-56594ce3ee69_del complete
Nov 28 01:17:52 user nova-compute[75266]: INFO nova.compute.manager [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 01:17:52 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:17:52 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Took 0.69 seconds to deallocate network for instance.
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.compute.manager [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-deleted-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:52 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:53 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Deleted allocations for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.860s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Acquiring lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Lock "8104f3b0-49a7-4036-8ff6-56594ce3ee69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] No waiting events found dispatching network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:17:53 user nova-compute[75266]: WARNING nova.compute.manager [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Received unexpected event network-vif-plugged-10103dcb-bcfe-4b53-8292-b97019bca924 for instance with vm_state deleted and task_state None.
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:17:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:17:57 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:18:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07b6bc44-64e6-4137-9046-4440e8274e07 is timed out.
Nov 28 01:18:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully detached device vdb from instance 07b6bc44-64e6-4137-9046-4440e8274e07 from the live domain config.
Nov 28 01:18:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYRoJxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:18:01 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac386732-ec79-4d04-8cd9-77c911a08070]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:18:01 user nova-compute[75266]: No targets found.
Nov 28 01:18:01 user nova-compute[75266]: iSNS:
Nov 28 01:18:01 user nova-compute[75266]: No targets found.
Nov 28 01:18:01 user nova-compute[75266]: STATIC:
Nov 28 01:18:01 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178
Nov 28 01:18:01 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:18:01 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:18:01 user nova-compute[75266]: FIRMWARE:
Nov 28 01:18:01 user nova-compute[75266]: No targets found.
Nov 28 01:18:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:18:01 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:18:01 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e3edd5-1d42-471e-877e-fe1eeeadacfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d4a73a-5d5f-4341-a1fc-29f215312ce6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)
Nov 28 01:18:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 (non-flash)
Nov 28 01:18:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c2d2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc79d65-95f1-4ab3-837e-4eb9a3e3930b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6b4b65-4735-4a03-bfc4-9b2aaf356683]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bbae4-e0c6-4d8f-86eb-8a24c52a5a25]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caed64a-a177-410c-8893-f250ca14643e]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef55fcd1-d11e-4417-bed3-2beaaa4d6fd3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f7b859-5784-4e8b-a0bf-911ad498448e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260]
Nov 28 01:18:02 user nova-compute[75266]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178, portal: 172.16.0.220,3260] successful.
Nov 28 01:18:02 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[71749454-76c4-4789-ba5a-72a65020c09f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== disconnect_volume: return (281ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:18:02 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'flavor' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.597s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:03 user nova-compute[75266]: INFO nova.compute.manager [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Terminating instance
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-unplugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] No waiting events found dispatching network-vif-unplugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.compute.manager [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-unplugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:18:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Instance destroyed successfully.
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'resources' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119539314',display_name='tempest-VolumesSnapshotTestJSON-instance-119539314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119539314',id=50,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpj2ahpkdCQ15cwkZMGch7JSD/r+/zmDjn1oN/gdKB8QXyI/CtT+qDM4lvGU4UDdbgh1DCRIdfmtyUre1w1/T79WC4lZzfzqtiICT8xSNmO6QPGEZ+eyUMa2FSy/6VZyQ==',key_name='tempest-keypair-2005613057',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:15:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dda55c6e8fd645869a7530dcb9910b25',ramdisk_id='',reservation_id='r-ig3g4ml8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1830776622',owner_user_name='tempest-VolumesSnapshotTestJSON-1830776622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90118ca36d3048568d1b1a1992a1408e',uuid=07b6bc44-64e6-4137-9046-4440e8274e07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converting VIF {"id": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "address": "fa:16:3e:51:66:ef", "network": {"id": "b825e2f0-6d05-4d76-a111-f0deffb0518f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1966037131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dda55c6e8fd645869a7530dcb9910b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf710a167-ab", "ovs_interfaceid": "f710a167-ab3b-4a35-8cf0-406177b5dc4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_vif [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf710a167-ab, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f312100-4d1c-4e2a-8a44-b959a177dc0e) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:03 user nova-compute[75266]: INFO os_vif [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:66:ef,bridge_name='br-int',has_traffic_filtering=True,id=f710a167-ab3b-4a35-8cf0-406177b5dc4d,network=Network(b825e2f0-6d05-4d76-a111-f0deffb0518f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf710a167-ab')
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:9df0213b-c844-4e5c-a2d3-eac2005b2178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYRoJxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:18:03 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[70d90bf3-7377-445c-9662-be6e65f55687]: Unexpected error while running command.
Nov 28 01:18:03 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:18:03 user nova-compute[75266]: Exit code: 21
Nov 28 01:18:03 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:18:03 user nova-compute[75266]: Stderr: '' {{(pid=86532) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 28 01:18:03 user nova-compute[75266]: Traceback (most recent call last):
Nov 28 01:18:03 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 28 01:18:03 user nova-compute[75266]:     ret = func(*f_args, **f_kwargs)
Nov 28 01:18:03 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 28 01:18:03 user nova-compute[75266]:     return func(*args, **kwargs)
Nov 28 01:18:03 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 28 01:18:03 user nova-compute[75266]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 28 01:18:03 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 28 01:18:03 user nova-compute[75266]:     return putils.execute(on_execute=on_execute,
Nov 28 01:18:03 user nova-compute[75266]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 28 01:18:03 user nova-compute[75266]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 28 01:18:03 user nova-compute[75266]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:18:03 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:18:03 user nova-compute[75266]: Exit code: 21
Nov 28 01:18:03 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:18:03 user nova-compute[75266]: Stderr: ''
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d90bf3-7377-445c-9662-be6e65f55687]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:18:03 user nova-compute[75266]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:18:03 user nova-compute[75266]: Exit code: 21
Nov 28 01:18:03 user nova-compute[75266]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:18:03 user nova-compute[75266]: Stderr: ''
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 28 01:18:03 user nova-compute[75266]: ERROR os_brick.initiator.connectors.iscsi 
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75266) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] <== disconnect_volume: return (25ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:18:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Deleting instance files /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07_del
Nov 28 01:18:03 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Deletion of /opt/stack/data/nova/instances/07b6bc44-64e6-4137-9046-4440e8274e07_del complete
Nov 28 01:18:03 user nova-compute[75266]: INFO nova.compute.manager [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 01:18:03 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:18:03 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:18:04 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Took 0.64 seconds to deallocate network for instance.
Nov 28 01:18:04 user nova-compute[75266]: WARNING nova.volume.cinder [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Attachment a3e27bec-ae9d-4b06-948f-991f46a49452 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a3e27bec-ae9d-4b06-948f-991f46a49452. (HTTP 404) (Request-ID: req-11ee8764-1b68-454f-9d1a-2c18ef96d9d7)
Nov 28 01:18:04 user nova-compute[75266]: INFO nova.compute.manager [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Took 0.02 seconds to detach 1 volumes for instance.
Nov 28 01:18:04 user nova-compute[75266]: DEBUG nova.compute.manager [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-deleted-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:18:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:04 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Deleted allocations for instance 07b6bc44-64e6-4137-9046-4440e8274e07
Nov 28 01:18:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "07b6bc44-64e6-4137-9046-4440e8274e07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.830s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:18:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Acquiring lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Lock "07b6bc44-64e6-4137-9046-4440e8274e07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:05 user nova-compute[75266]: DEBUG nova.compute.manager [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] No waiting events found dispatching network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:18:05 user nova-compute[75266]: WARNING nova.compute.manager [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Received unexpected event network-vif-plugged-f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance with vm_state deleted and task_state None.
Nov 28 01:18:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:18:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:22 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:18:22 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:18:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:38 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:42 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:18:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:44 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:18:45 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:18:45 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9072MB free_disk=25.07202911376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:18:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:18:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:49 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:18:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:18:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:18:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:18:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:18:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:18:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:03 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:19:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:13 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:23 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:28 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:19:32 user nova-compute[75266]: INFO nova.compute.claims [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Claim successful on node user
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:19:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.policy [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:19:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Creating image(s)
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "b65471292a2079ea96416f0b393212595c2b42e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "b65471292a2079ea96416f0b393212595c2b42e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Successfully created port: 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG nova.virt.images [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 5134e6f4-67bb-4398-9322-d26991a40a07 was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.part /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.part /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.converted" returned: 0 in 0.245s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "b65471292a2079ea96416f0b393212595c2b42e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.218s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Successfully updated port: 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.compute.manager [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing instance network info cache due to event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json" returned: 0 in 0.200s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "b65471292a2079ea96416f0b393212595c2b42e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "b65471292a2079ea96416f0b393212595c2b42e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4,backing_fmt=raw /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4,backing_fmt=raw /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk 1073741824" returned: 0 in 0.049s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "b65471292a2079ea96416f0b393212595c2b42e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance network_info: |[{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.network.neutron [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Cannot resize image /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Ensure instance console log exists: /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start _get_guest_xml network_info=[{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T01:19:29Z,direct_url=<?>,disk_format='qcow2',id=5134e6f4-67bb-4398-9322-d26991a40a07,min_disk=0,min_ram=0,name='tempest-scenario-img--1186837285',owner='b60fd2418cf34127830ceed618456a71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T01:19:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '5134e6f4-67bb-4398-9322-d26991a40a07'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:19:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:19:34 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T01:19:29Z,direct_url=<?>,disk_format='qcow2',id=5134e6f4-67bb-4398-9322-d26991a40a07,min_disk=0,min_ram=0,name='tempest-scenario-img--1186837285',owner='b60fd2418cf34127830ceed618456a71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T01:19:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:19:34 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:19:33Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'pci_devices' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:19:35 user nova-compute[75266]:   <uuid>169464fe-1c40-4704-b901-1788c2d6860b</uuid>
Nov 28 01:19:35 user nova-compute[75266]:   <name>instance-00000033</name>
Nov 28 01:19:35 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:19:35 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:19:35 user nova-compute[75266]:   <metadata>
Nov 28 01:19:35 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:19:35 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:name>tempest-TestMinimumBasicScenario-server-1980639582</nova:name>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:19:34</nova:creationTime>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:19:35 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:19:35 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:owner>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:user uuid="9840cdc8142e46199dd32a7ea108ea4a">tempest-TestMinimumBasicScenario-1587536658-project-member</nova:user>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:project uuid="b60fd2418cf34127830ceed618456a71">tempest-TestMinimumBasicScenario-1587536658</nova:project>
Nov 28 01:19:35 user nova-compute[75266]:       </nova:owner>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:root type="image" uuid="5134e6f4-67bb-4398-9322-d26991a40a07"/>
Nov 28 01:19:35 user nova-compute[75266]:       <nova:ports>
Nov 28 01:19:35 user nova-compute[75266]:         <nova:port uuid="58ee7f1d-9559-46d2-bda9-ed31cbb522f7">
Nov 28 01:19:35 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 01:19:35 user nova-compute[75266]:         </nova:port>
Nov 28 01:19:35 user nova-compute[75266]:       </nova:ports>
Nov 28 01:19:35 user nova-compute[75266]:     </nova:instance>
Nov 28 01:19:35 user nova-compute[75266]:   </metadata>
Nov 28 01:19:35 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:19:35 user nova-compute[75266]:     <system>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="serial">169464fe-1c40-4704-b901-1788c2d6860b</entry>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="uuid">169464fe-1c40-4704-b901-1788c2d6860b</entry>
Nov 28 01:19:35 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:19:35 user nova-compute[75266]:     </system>
Nov 28 01:19:35 user nova-compute[75266]:   </sysinfo>
Nov 28 01:19:35 user nova-compute[75266]:   <os>
Nov 28 01:19:35 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:19:35 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:19:35 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:19:35 user nova-compute[75266]:   </os>
Nov 28 01:19:35 user nova-compute[75266]:   <features>
Nov 28 01:19:35 user nova-compute[75266]:     <acpi/>
Nov 28 01:19:35 user nova-compute[75266]:     <apic/>
Nov 28 01:19:35 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:19:35 user nova-compute[75266]:   </features>
Nov 28 01:19:35 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:19:35 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:19:35 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:19:35 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:19:35 user nova-compute[75266]:   </clock>
Nov 28 01:19:35 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:19:35 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:19:35 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:19:35 user nova-compute[75266]:   </cpu>
Nov 28 01:19:35 user nova-compute[75266]:   <devices>
Nov 28 01:19:35 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:19:35 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:19:35 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk"/>
Nov 28 01:19:35 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:19:35 user nova-compute[75266]:     </disk>
Nov 28 01:19:35 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:19:35 user nova-compute[75266]:       <mac address="fa:16:3e:c3:c4:1e"/>
Nov 28 01:19:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:19:35 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:19:35 user nova-compute[75266]:       <target dev="tap58ee7f1d-95"/>
Nov 28 01:19:35 user nova-compute[75266]:     </interface>
Nov 28 01:19:35 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:19:35 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/console.log" append="off"/>
Nov 28 01:19:35 user nova-compute[75266]:     </serial>
Nov 28 01:19:35 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:19:35 user nova-compute[75266]:     <video>
Nov 28 01:19:35 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:19:35 user nova-compute[75266]:     </video>
Nov 28 01:19:35 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:19:35 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:19:35 user nova-compute[75266]:     </rng>
Nov 28 01:19:35 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:19:35 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:19:35 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:19:35 user nova-compute[75266]:     </memballoon>
Nov 28 01:19:35 user nova-compute[75266]:   </devices>
Nov 28 01:19:35 user nova-compute[75266]: </domain>
Nov 28 01:19:35 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:19:33Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG os_vif [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3990778b-5327-57c4-886c-2170f66c4ecc', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ee7f1d-95, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58ee7f1d-95, col_values=(('qos', UUID('aa091ac8-fceb-4ab8-a4a6-6f302b5f1c0f')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58ee7f1d-95, col_values=(('external_ids', {'iface-id': '58ee7f1d-9559-46d2-bda9-ed31cbb522f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:c4:1e', 'vm-uuid': '169464fe-1c40-4704-b901-1788c2d6860b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:35 user nova-compute[75266]: INFO os_vif [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95')
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated VIF entry in instance network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.network.neutron [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:19:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No VIF found with MAC fa:16:3e:c3:c4:1e, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:19:36 user nova-compute[75266]: WARNING nova.compute.manager [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state building and task_state spawning.
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:19:38 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance spawned successfully.
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:19:38 user nova-compute[75266]: INFO nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:19:38 user nova-compute[75266]: WARNING nova.compute.manager [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state building and task_state spawning.
Nov 28 01:19:38 user nova-compute[75266]: INFO nova.compute.manager [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Took 6.31 seconds to build instance.
Nov 28 01:19:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.416s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:43 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:19:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:19:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.00738525390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 169464fe-1c40-4704-b901-1788c2d6860b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:19:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:19:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:19:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:19:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:19:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:19:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:19:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:19:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:44 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:20:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:20:46 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:20:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:20:47 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.979034423828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 169464fe-1c40-4704-b901-1788c2d6860b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:20:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:20:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:51 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:20:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:20:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:20:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:20:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:20:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:20:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:20:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:20:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:25 user nova-compute[75266]: INFO nova.compute.manager [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Attaching volume 3186a30c-266c-418f-8c6e-f386e1ecc445 to /dev/vdb
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.utils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bad8bd-5621-4f6d-9e4a-8a3f754b1dcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd482a11-2c26-40f8-8c5d-15234f006bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47ee76-e3c2-43ab-b6ad-49a0a91a343a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6eb8ee-926e-4649-8a9d-ecb47e7b7d49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:21:26 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:21:26 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0923977-7084-41f9-a257-271617397b40]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG os_brick.utils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:21:26 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating existing volume attachment record: d3b168df-3e68-4a8e-830c-8fb339aa04fb {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:21:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:21:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:21:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:21:32 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[547efff5-4fd9-4ee5-8131-237b394bcdf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:21:32 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185beaf-6bd2-4d90-aef3-005d191ac8b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445] added
Nov 28 01:21:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ba76d-8590-4896-89cb-13c1b548028f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f944e1e-e803-40ba-ab9c-37a2f9f24abf]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYIyMuPQ {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYIyMuPQ" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ce6a0-ef12-4adc-86df-f40c693e642d]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYIyMuPQ'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1dc0e6-e0f3-4df6-b793-5f087bd844f5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7a6b8b-3d81-4a4a-b2f5-d97fe34ca449]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:21:32 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:21:32 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:21:32 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:21:32 user nova-compute[75266]: 
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0438349c-9f37-4582-93fe-501d8f637800]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]
Nov 28 01:21:32 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.
Nov 28 01:21:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b710aa4b-f4b3-4907-a1c1-e5b64c31c795]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9cb6d-884a-43b2-b0e6-0d4adeaffed2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:33 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:33 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b7670-39e1-4598-b895-6369350ecad0]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:21:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23039636537393638', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039636537393638', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.objects.instance [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:21:34 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:21:34 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:21:34 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:21:34 user nova-compute[75266]:   <serial>3186a30c-266c-418f-8c6e-f386e1ecc445</serial>
Nov 28 01:21:34 user nova-compute[75266]: </disk>
Nov 28 01:21:34 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No VIF found with MAC fa:16:3e:c3:c4:1e, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:21:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.666s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG nova.compute.manager [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing instance network info cache due to event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:21:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:21:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated VIF entry in instance network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:21:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:21:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:21:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG nova.compute.manager [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing instance network info cache due to event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated VIF entry in instance network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG nova.network.neutron [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:21:43 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:21:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:46 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:47 user nova-compute[75266]: INFO nova.compute.manager [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Rebooting instance
Nov 28 01:21:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:21:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:21:47 user nova-compute[75266]: DEBUG nova.network.neutron [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG nova.network.neutron [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG nova.compute.manager [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:48 user nova-compute[75266]: WARNING nova.compute.manager [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:48 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance destroyed successfully.
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.objects.instance [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'resources' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:21:48Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ee7f1d-95, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa091ac8-fceb-4ab8-a4a6-6f302b5f1c0f) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:49 user nova-compute[75266]: INFO os_vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95')
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:21:49 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b8995f-6855-482f-911d-1f86e423f6d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:21:49 user nova-compute[75266]: No targets found.
Nov 28 01:21:49 user nova-compute[75266]: iSNS:
Nov 28 01:21:49 user nova-compute[75266]: No targets found.
Nov 28 01:21:49 user nova-compute[75266]: STATIC:
Nov 28 01:21:49 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445
Nov 28 01:21:49 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:21:49 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:21:49 user nova-compute[75266]: FIRMWARE:
Nov 28 01:21:49 user nova-compute[75266]: No targets found.
Nov 28 01:21:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:21:49 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:21:49 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae1059-e1f6-4683-bdb7-70da4d978005]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea3605a-7fd9-442f-8b11-ba012487cc33]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c5ea4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9c7278-2ec7-4276-9703-709958b7e729]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf5ee6-5a72-42cb-9bf3-3e17051a8287]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bf6fd-a02b-41f9-a54f-91e3a477a96c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c47927-1cce-4ea0-a3f5-7ea6f1703332]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99f9d6d-9072-49a3-93a5-cc9571da6e82]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb61fe-e7d7-4858-91de-c16a2cb739e2]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]
Nov 28 01:21:49 user nova-compute[75266]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.
Nov 28 01:21:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171dcf3-a0c0-4aaf-a850-d0475f6e2f7b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== disconnect_volume: return (383ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start _get_guest_xml network_info=[{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5134e6f4-67bb-4398-9322-d26991a40a07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '5134e6f4-67bb-4398-9322-d26991a40a07'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '169464fe-1c40-4704-b901-1788c2d6860b', 'attached_at': '', 'detached_at': '', 'volume_id': '3186a30c-266c-418f-8c6e-f386e1ecc445', 'serial': '3186a30c-266c-418f-8c6e-f386e1ecc445'}, 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd3b168df-3e68-4a8e-830c-8fb339aa04fb', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:21:49 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:21:49 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5134e6f4-67bb-4398-9322-d26991a40a07,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.objects.instance [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'vcpu_model' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.objects.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Object Instance<169464fe-1c40-4704-b901-1788c2d6860b> lazy-loaded attributes: resources,vcpu_model {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:21:49 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:21:49 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:21:49 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70c6a1-fd10-470e-88d2-6e936c2e78c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:21:49 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:21:49 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:21:49 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9099MB free_disk=24.977619171142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd76e40-892d-4dcb-a193-89697a1275c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445] added
Nov 28 01:21:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[44481b13-c68e-4eb6-ba76-0403e8328c70]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2cfd9a-4bee-4fa3-ac45-23b274504fa5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYIyMuPQ {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 169464fe-1c40-4704-b901-1788c2d6860b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYIyMuPQ" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c883bf5-d5e7-412c-bda3-83b6658c9db3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYIyMuPQ'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[67446edc-41af-46dc-a552-7882ca4909f4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f2cf1-2dd3-41f7-ba97-a167f0053ad1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:21:50 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:21:50 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:21:50 user nova-compute[75266]: 
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c58f91-fb41-4630-b412-a9ed3000fa74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]
Nov 28 01:21:50 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.
Nov 28 01:21:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[da746ee6-002e-478c-b9b4-7ddb26854b1b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cde669-4680-49a6-a7d6-32157a215cf5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:21:50 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.613s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[524bb8fd-280b-4c3b-852a-f0c578d89be2]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:50 user nova-compute[75266]: DEBUG nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:50 user nova-compute[75266]: WARNING nova.compute.manager [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:51 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.644s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== connect_volume: return (1645ms) {'type': 'block', 'scsi_wwn': '23039636537393638', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039636537393638', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:21:48Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'pci_devices' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.objects.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Object Instance<169464fe-1c40-4704-b901-1788c2d6860b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:21:51 user nova-compute[75266]:   <uuid>169464fe-1c40-4704-b901-1788c2d6860b</uuid>
Nov 28 01:21:51 user nova-compute[75266]:   <name>instance-00000033</name>
Nov 28 01:21:51 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:21:51 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:21:51 user nova-compute[75266]:   <metadata>
Nov 28 01:21:51 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:21:51 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:name>tempest-TestMinimumBasicScenario-server-1980639582</nova:name>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:21:49</nova:creationTime>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:21:51 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:21:51 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:owner>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:user uuid="9840cdc8142e46199dd32a7ea108ea4a">tempest-TestMinimumBasicScenario-1587536658-project-member</nova:user>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:project uuid="b60fd2418cf34127830ceed618456a71">tempest-TestMinimumBasicScenario-1587536658</nova:project>
Nov 28 01:21:51 user nova-compute[75266]:       </nova:owner>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:root type="image" uuid="5134e6f4-67bb-4398-9322-d26991a40a07"/>
Nov 28 01:21:51 user nova-compute[75266]:       <nova:ports>
Nov 28 01:21:51 user nova-compute[75266]:         <nova:port uuid="58ee7f1d-9559-46d2-bda9-ed31cbb522f7">
Nov 28 01:21:51 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 01:21:51 user nova-compute[75266]:         </nova:port>
Nov 28 01:21:51 user nova-compute[75266]:       </nova:ports>
Nov 28 01:21:51 user nova-compute[75266]:     </nova:instance>
Nov 28 01:21:51 user nova-compute[75266]:   </metadata>
Nov 28 01:21:51 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:21:51 user nova-compute[75266]:     <system>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="serial">169464fe-1c40-4704-b901-1788c2d6860b</entry>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="uuid">169464fe-1c40-4704-b901-1788c2d6860b</entry>
Nov 28 01:21:51 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:21:51 user nova-compute[75266]:     </system>
Nov 28 01:21:51 user nova-compute[75266]:   </sysinfo>
Nov 28 01:21:51 user nova-compute[75266]:   <os>
Nov 28 01:21:51 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:21:51 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:21:51 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:21:51 user nova-compute[75266]:   </os>
Nov 28 01:21:51 user nova-compute[75266]:   <features>
Nov 28 01:21:51 user nova-compute[75266]:     <acpi/>
Nov 28 01:21:51 user nova-compute[75266]:     <apic/>
Nov 28 01:21:51 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:21:51 user nova-compute[75266]:   </features>
Nov 28 01:21:51 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:21:51 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:21:51 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:21:51 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:21:51 user nova-compute[75266]:   </clock>
Nov 28 01:21:51 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:21:51 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:21:51 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:21:51 user nova-compute[75266]:   </cpu>
Nov 28 01:21:51 user nova-compute[75266]:   <devices>
Nov 28 01:21:51 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:21:51 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:21:51 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk"/>
Nov 28 01:21:51 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:21:51 user nova-compute[75266]:     </disk>
Nov 28 01:21:51 user nova-compute[75266]:     <disk type="block" device="disk">
Nov 28 01:21:51 user nova-compute[75266]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:21:51 user nova-compute[75266]:       <source dev="/dev/sdb"/>
Nov 28 01:21:51 user nova-compute[75266]:       <target dev="vdb" bus="virtio"/>
Nov 28 01:21:51 user nova-compute[75266]:       <serial>3186a30c-266c-418f-8c6e-f386e1ecc445</serial>
Nov 28 01:21:51 user nova-compute[75266]:     </disk>
Nov 28 01:21:51 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:21:51 user nova-compute[75266]:       <mac address="fa:16:3e:c3:c4:1e"/>
Nov 28 01:21:51 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:21:51 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:21:51 user nova-compute[75266]:       <target dev="tap58ee7f1d-95"/>
Nov 28 01:21:51 user nova-compute[75266]:     </interface>
Nov 28 01:21:51 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:21:51 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/console.log" append="off"/>
Nov 28 01:21:51 user nova-compute[75266]:     </serial>
Nov 28 01:21:51 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:21:51 user nova-compute[75266]:     <video>
Nov 28 01:21:51 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:21:51 user nova-compute[75266]:     </video>
Nov 28 01:21:51 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:21:51 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:21:51 user nova-compute[75266]:     </rng>
Nov 28 01:21:51 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:21:51 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:21:51 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:21:51 user nova-compute[75266]:     </memballoon>
Nov 28 01:21:51 user nova-compute[75266]:   </devices>
Nov 28 01:21:51 user nova-compute[75266]: </domain>
Nov 28 01:21:51 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.objects.instance [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'trusted_certs' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.objects.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Object Instance<169464fe-1c40-4704-b901-1788c2d6860b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b65471292a2079ea96416f0b393212595c2b42e4 --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:21:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Cannot resize image /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.objects.instance [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'migration_context' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.objects.base [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Object Instance<169464fe-1c40-4704-b901-1788c2d6860b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75266) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:21:48Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG os_vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3990778b-5327-57c4-886c-2170f66c4ecc', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ee7f1d-95, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58ee7f1d-95, col_values=(('qos', UUID('8d30569b-eb44-4eb1-af20-abc63560662d')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58ee7f1d-95, col_values=(('external_ids', {'iface-id': '58ee7f1d-9559-46d2-bda9-ed31cbb522f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:c4:1e', 'vm-uuid': '169464fe-1c40-4704-b901-1788c2d6860b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:52 user nova-compute[75266]: INFO os_vif [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95')
Nov 28 01:21:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:52 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.compute.manager [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:53 user nova-compute[75266]: WARNING nova.compute.manager [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state reboot_started_hard.
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:53 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:21:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:21:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:21:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:21:55 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance rebooted successfully.
Nov 28 01:21:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.907s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:21:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:21:55 user nova-compute[75266]: WARNING nova.compute.manager [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state active and task_state None.
Nov 28 01:21:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:21:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:21:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:47 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:22:50 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:22:51 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:22:51 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.976036071777344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 169464fe-1c40-4704-b901-1788c2d6860b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:22:51 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:22:52 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:22:52 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:22:52 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:22:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:22:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:53 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:22:54 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:22:55 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:22:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:22:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:22:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:22:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:22:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:22:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:23 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:23:23 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG nova.compute.manager [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing instance network info cache due to event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:23:39 user nova-compute[75266]: DEBUG nova.network.neutron [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:23:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated VIF entry in instance network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:23:40 user nova-compute[75266]: DEBUG nova.network.neutron [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:23:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:23:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:23:40 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:23:41 user nova-compute[75266]: INFO nova.compute.manager [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Detaching volume 3186a30c-266c-418f-8c6e-f386e1ecc445
Nov 28 01:23:41 user nova-compute[75266]: INFO nova.virt.block_device [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Attempting to driver detach volume 3186a30c-266c-418f-8c6e-f386e1ecc445 from mountpoint /dev/vdb
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Attempting to detach device vdb from instance 169464fe-1c40-4704-b901-1788c2d6860b from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:23:41 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:23:41 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:23:41 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:23:41 user nova-compute[75266]:   <serial>3186a30c-266c-418f-8c6e-f386e1ecc445</serial>
Nov 28 01:23:41 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 01:23:41 user nova-compute[75266]: </disk>
Nov 28 01:23:41 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:23:41 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully detached device vdb from instance 169464fe-1c40-4704-b901-1788c2d6860b from the persistent domain config.
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 169464fe-1c40-4704-b901-1788c2d6860b from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:23:41 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:23:41 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:23:41 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:23:41 user nova-compute[75266]:   <serial>3186a30c-266c-418f-8c6e-f386e1ecc445</serial>
Nov 28 01:23:41 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 01:23:41 user nova-compute[75266]: </disk>
Nov 28 01:23:41 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.compute.manager [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing instance network info cache due to event network-changed-58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:23:41 user nova-compute[75266]: DEBUG nova.network.neutron [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Refreshing network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:23:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated VIF entry in instance network info cache for port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:23:42 user nova-compute[75266]: DEBUG nova.network.neutron [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:23:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:49 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:23:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:23:53 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:23:53 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.96746063232422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 169464fe-1c40-4704-b901-1788c2d6860b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:23:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:23:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:54 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:23:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:23:56 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [{"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-169464fe-1c40-4704-b901-1788c2d6860b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:23:57 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:23:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 169464fe-1c40-4704-b901-1788c2d6860b is timed out.
Nov 28 01:24:01 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully detached device vdb from instance 169464fe-1c40-4704-b901-1788c2d6860b from the live domain config.
Nov 28 01:24:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYIyMuPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:24:01 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4829bd23-01c4-4d58-a9b7-620a5e3a46cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:24:01 user nova-compute[75266]: No targets found.
Nov 28 01:24:01 user nova-compute[75266]: iSNS:
Nov 28 01:24:01 user nova-compute[75266]: No targets found.
Nov 28 01:24:01 user nova-compute[75266]: STATIC:
Nov 28 01:24:01 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445
Nov 28 01:24:01 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:24:01 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:24:01 user nova-compute[75266]: FIRMWARE:
Nov 28 01:24:01 user nova-compute[75266]: No targets found.
Nov 28 01:24:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:24:01 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:24:01 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727b03c-e689-4f6f-b4b7-bd5f205ec9a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e19a8-6f1a-4cdd-a3e8-770579babc5a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:24:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 (non-flash)
Nov 28 01:24:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b7c343490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9599e0-9308-4297-8884-7e6617c81965]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1daedff-8837-4deb-ba13-c4a5fcc1d510]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec8289-f83f-4da8-ad6f-ce1aae8b463b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b549d4a-5b35-4c51-ab8f-bb561fbc9a65]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a5a9a-dbac-4de2-b57b-4358111c0c5b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d341673c-d2fd-4fd6-89be-42b7944f907e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260]
Nov 28 01:24:01 user nova-compute[75266]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445, portal: 172.16.0.220,3260] successful.
Nov 28 01:24:01 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3186a30c-266c-418f-8c6e-f386e1ecc445 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8b147-1d24-4d87-b80b-0380fa9f0b5e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== disconnect_volume: return (305ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:24:01 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG nova.objects.instance [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:24:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:24:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:34 user nova-compute[75266]: INFO nova.compute.manager [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Terminating instance
Nov 28 01:24:34 user nova-compute[75266]: DEBUG nova.compute.manager [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Instance destroyed successfully.
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.objects.instance [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'resources' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980639582',display_name='tempest-TestMinimumBasicScenario-server-1980639582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980639582',id=51,image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg==',key_name='tempest-TestMinimumBasicScenario-118115395',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-ie3q3lys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5134e6f4-67bb-4398-9322-d26991a40a07',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:21:55Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=169464fe-1c40-4704-b901-1788c2d6860b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "address": "fa:16:3e:c3:c4:1e", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ee7f1d-95", "ovs_interfaceid": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG os_vif [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ee7f1d-95, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d30569b-eb44-4eb1-af20-abc63560662d) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:24:35 user nova-compute[75266]: INFO os_vif [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:c4:1e,bridge_name='br-int',has_traffic_filtering=True,id=58ee7f1d-9559-46d2-bda9-ed31cbb522f7,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ee7f1d-95')
Nov 28 01:24:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Deleting instance files /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b_del
Nov 28 01:24:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Deletion of /opt/stack/data/nova/instances/169464fe-1c40-4704-b901-1788c2d6860b_del complete
Nov 28 01:24:35 user nova-compute[75266]: INFO nova.compute.manager [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 01:24:35 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:24:35 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-unplugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:24:36 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Took 0.70 seconds to deallocate network for instance.
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-deleted-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:36 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Deleted allocations for instance 169464fe-1c40-4704-b901-1788c2d6860b
Nov 28 01:24:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "169464fe-1c40-4704-b901-1788c2d6860b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.908s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:24:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Acquiring lock "169464fe-1c40-4704-b901-1788c2d6860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Lock "169464fe-1c40-4704-b901-1788c2d6860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] No waiting events found dispatching network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:24:38 user nova-compute[75266]: WARNING nova.compute.manager [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Received unexpected event network-vif-plugged-58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance with vm_state deleted and task_state None.
Nov 28 01:24:40 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:50 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:51 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:54 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:54 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:24:55 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:24:55 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=24.99477767944336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:24:55 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:24:56 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:24:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:24:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:00 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:05 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:10 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:15 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:20 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:25:29 user nova-compute[75266]: INFO nova.compute.claims [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Claim successful on node user
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:25:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.policy [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:25:29 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Creating image(s)
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "/opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "/opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:29 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.part --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Successfully created port: 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG nova.virt.images [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 63ddbc17-c77e-4a11-a873-5d13f598a449 was qcow2, converting to raw {{(pid=75266) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG nova.privsep.utils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75266) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.part /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.converted {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.part /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.converted" returned: 0 in 0.332s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.converted --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:30 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Successfully updated port: 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-changed-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing instance network info cache due to event network-changed-827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.339s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json" returned: 0 in 0.183s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance network_info: |[{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40,backing_fmt=raw /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40,backing_fmt=raw /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk 1073741824" returned: 0 in 0.056s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "080dbbf3e6dcded45b88814c60cf99d69b114b40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/080dbbf3e6dcded45b88814c60cf99d69b114b40 --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated VIF entry in instance network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Cannot resize image /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Ensure instance console log exists: /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Start _get_guest_xml network_info=[{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T01:25:26Z,direct_url=<?>,disk_format='qcow2',id=63ddbc17-c77e-4a11-a873-5d13f598a449,min_disk=0,min_ram=0,name='tempest-scenario-img--2003452789',owner='b60fd2418cf34127830ceed618456a71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T01:25:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '63ddbc17-c77e-4a11-a873-5d13f598a449'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:25:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:25:31 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T01:25:26Z,direct_url=<?>,disk_format='qcow2',id=63ddbc17-c77e-4a11-a873-5d13f598a449,min_disk=0,min_ram=0,name='tempest-scenario-img--2003452789',owner='b60fd2418cf34127830ceed618456a71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T01:25:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1106131125',display_name='tempest-TestMinimumBasicScenario-server-1106131125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1106131125',id=52,image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKk0HMutZ3A7ZcKNBcqzYb2VbFeXHKOMxlkuRwObh2Oe2mwtlTpGXIpQQR7Mgy/j9iU2B54VME97nsb2V2QJpVr1s0iPWYIVi2Du6e0eOYgS6kJvy0AsnOQV1yutIdb+A==',key_name='tempest-TestMinimumBasicScenario-1936314097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-oa5033d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:25:30Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=8eeb3fc2-2a1a-4496-a74a-acda3bb9965b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.objects.instance [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:25:31 user nova-compute[75266]:   <uuid>8eeb3fc2-2a1a-4496-a74a-acda3bb9965b</uuid>
Nov 28 01:25:31 user nova-compute[75266]:   <name>instance-00000034</name>
Nov 28 01:25:31 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:25:31 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:25:31 user nova-compute[75266]:   <metadata>
Nov 28 01:25:31 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:25:31 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:name>tempest-TestMinimumBasicScenario-server-1106131125</nova:name>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:25:31</nova:creationTime>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:25:31 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:25:31 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:owner>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:user uuid="9840cdc8142e46199dd32a7ea108ea4a">tempest-TestMinimumBasicScenario-1587536658-project-member</nova:user>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:project uuid="b60fd2418cf34127830ceed618456a71">tempest-TestMinimumBasicScenario-1587536658</nova:project>
Nov 28 01:25:31 user nova-compute[75266]:       </nova:owner>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:root type="image" uuid="63ddbc17-c77e-4a11-a873-5d13f598a449"/>
Nov 28 01:25:31 user nova-compute[75266]:       <nova:ports>
Nov 28 01:25:31 user nova-compute[75266]:         <nova:port uuid="827702b3-6c9e-4d07-8324-598c38a33808">
Nov 28 01:25:31 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 01:25:31 user nova-compute[75266]:         </nova:port>
Nov 28 01:25:31 user nova-compute[75266]:       </nova:ports>
Nov 28 01:25:31 user nova-compute[75266]:     </nova:instance>
Nov 28 01:25:31 user nova-compute[75266]:   </metadata>
Nov 28 01:25:31 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:25:31 user nova-compute[75266]:     <system>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="serial">8eeb3fc2-2a1a-4496-a74a-acda3bb9965b</entry>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="uuid">8eeb3fc2-2a1a-4496-a74a-acda3bb9965b</entry>
Nov 28 01:25:31 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:25:31 user nova-compute[75266]:     </system>
Nov 28 01:25:31 user nova-compute[75266]:   </sysinfo>
Nov 28 01:25:31 user nova-compute[75266]:   <os>
Nov 28 01:25:31 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:25:31 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:25:31 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:25:31 user nova-compute[75266]:   </os>
Nov 28 01:25:31 user nova-compute[75266]:   <features>
Nov 28 01:25:31 user nova-compute[75266]:     <acpi/>
Nov 28 01:25:31 user nova-compute[75266]:     <apic/>
Nov 28 01:25:31 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:25:31 user nova-compute[75266]:   </features>
Nov 28 01:25:31 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:25:31 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:25:31 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:25:31 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:25:31 user nova-compute[75266]:   </clock>
Nov 28 01:25:31 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:25:31 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:25:31 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:25:31 user nova-compute[75266]:   </cpu>
Nov 28 01:25:31 user nova-compute[75266]:   <devices>
Nov 28 01:25:31 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:25:31 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:25:31 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk"/>
Nov 28 01:25:31 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:25:31 user nova-compute[75266]:     </disk>
Nov 28 01:25:31 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:25:31 user nova-compute[75266]:       <mac address="fa:16:3e:f6:93:16"/>
Nov 28 01:25:31 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:25:31 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:25:31 user nova-compute[75266]:       <target dev="tap827702b3-6c"/>
Nov 28 01:25:31 user nova-compute[75266]:     </interface>
Nov 28 01:25:31 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:25:31 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/console.log" append="off"/>
Nov 28 01:25:31 user nova-compute[75266]:     </serial>
Nov 28 01:25:31 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:25:31 user nova-compute[75266]:     <video>
Nov 28 01:25:31 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:25:31 user nova-compute[75266]:     </video>
Nov 28 01:25:31 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:25:31 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:25:31 user nova-compute[75266]:     </rng>
Nov 28 01:25:31 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:25:31 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:25:31 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:25:31 user nova-compute[75266]:     </memballoon>
Nov 28 01:25:31 user nova-compute[75266]:   </devices>
Nov 28 01:25:31 user nova-compute[75266]: </domain>
Nov 28 01:25:31 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1106131125',display_name='tempest-TestMinimumBasicScenario-server-1106131125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1106131125',id=52,image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKk0HMutZ3A7ZcKNBcqzYb2VbFeXHKOMxlkuRwObh2Oe2mwtlTpGXIpQQR7Mgy/j9iU2B54VME97nsb2V2QJpVr1s0iPWYIVi2Du6e0eOYgS6kJvy0AsnOQV1yutIdb+A==',key_name='tempest-TestMinimumBasicScenario-1936314097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-oa5033d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:25:30Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=8eeb3fc2-2a1a-4496-a74a-acda3bb9965b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG os_vif [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c17fe1b2-f346-5f21-a147-99ed3da35d90', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap827702b3-6c, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap827702b3-6c, col_values=(('qos', UUID('65623d9b-5cc4-44d6-8e09-5551bfd6d244')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap827702b3-6c, col_values=(('external_ids', {'iface-id': '827702b3-6c9e-4d07-8324-598c38a33808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:93:16', 'vm-uuid': '8eeb3fc2-2a1a-4496-a74a-acda3bb9965b'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:32 user nova-compute[75266]: INFO os_vif [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c')
Nov 28 01:25:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:25:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No VIF found with MAC fa:16:3e:f6:93:16, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:33 user nova-compute[75266]: DEBUG nova.compute.manager [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:25:33 user nova-compute[75266]: WARNING nova.compute.manager [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state building and task_state spawning.
Nov 28 01:25:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:34 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:25:35 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance spawned successfully.
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:25:35 user nova-compute[75266]: INFO nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:35 user nova-compute[75266]: DEBUG nova.compute.manager [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:25:35 user nova-compute[75266]: WARNING nova.compute.manager [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state building and task_state spawning.
Nov 28 01:25:35 user nova-compute[75266]: INFO nova.compute.manager [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Took 6.48 seconds to build instance.
Nov 28 01:25:35 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.594s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:25:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:25:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:25:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:25:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=24.945785522460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:25:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:25:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:25:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:25:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:25:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:25:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:26:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:26:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:26:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:54 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:26:55 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:26:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:26:56 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.94375228881836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:26:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:26:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:26:58 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:26:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:27:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:22 user nova-compute[75266]: INFO nova.compute.manager [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Attaching volume de772352-1a57-4511-9b60-8a9e89341b97 to /dev/vdb
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[92069e5c-7554-4b94-abaf-93c6c937b936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630f266-3848-4376-bad7-b6fdb473ca8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[55014579-9ce4-452f-bb15-121164800f4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6521952d-1e5b-4dda-8061-16f3cf69e0de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:27:22 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:27:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1469f2f-4e82-4f80-a898-940eb42aff2a]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:27:22 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating existing volume attachment record: f2fe8f0c-aef6-4f78-b7d4-e8536e24c549 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:27:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DevgfVZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:27:31 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:27:31 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:27:31 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b0eb3-374c-456c-922b-b00134af648c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:27:31 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c2aa2f-f25d-4139-89c6-e9dd1816703c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97] added
Nov 28 01:27:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd4c35-2ff7-44cb-aa18-e8b940b98716]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e8cd9-f54c-419a-8698-d6b80984a9c3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DevgfVZt {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DevgfVZt" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9fad10-3961-4ad7-ac2f-60b563a524ee]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DevgfVZt'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacdae4-0ca1-45fb-9adf-1066c871b5c4]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295adb3-7c59-47a9-888d-bbd19e742865]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:27:31 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:27:31 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:27:31 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:27:31 user nova-compute[75266]: 
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[542aad76-ad73-4e6c-8f59-36263dc996f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260]
Nov 28 01:27:31 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260] successful.
Nov 28 01:27:31 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b1b961-d7fd-4761-b9ba-e193875f26e8]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:27:31 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff75e9-3440-43da-b0dc-cf21852f08b1]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)
Nov 28 01:27:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)
Nov 28 01:27:32 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca411ee7-e239-4af8-beb6-fd2aa9e8d160]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:27:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DevgfVZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26338303736613732', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303736613732', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.objects.instance [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:27:33 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:27:33 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:27:33 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:27:33 user nova-compute[75266]:   <serial>de772352-1a57-4511-9b60-8a9e89341b97</serial>
Nov 28 01:27:33 user nova-compute[75266]: </disk>
Nov 28 01:27:33 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] No VIF found with MAC fa:16:3e:f6:93:16, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:27:33 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.928s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:35 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-changed-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG nova.compute.manager [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing instance network info cache due to event network-changed-827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated VIF entry in instance network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG nova.network.neutron [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:27:36 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:27:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-changed-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG nova.compute.manager [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing instance network info cache due to event network-changed-827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG nova.network.neutron [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG nova.network.neutron [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated VIF entry in instance network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:27:38 user nova-compute[75266]: DEBUG nova.network.neutron [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:39 user nova-compute[75266]: INFO nova.compute.manager [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Rebooting instance
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG nova.network.neutron [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:27:39 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:27:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:42 user nova-compute[75266]: DEBUG nova.compute.manager [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:27:42 user nova-compute[75266]: WARNING nova.compute.manager [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state active and task_state reboot_started.
Nov 28 01:27:42 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance shutdown successfully.
Nov 28 01:27:43 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG nova.compute.manager [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:27:44 user nova-compute[75266]: WARNING nova.compute.manager [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state active and task_state reboot_started.
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:44 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance running successfully.
Nov 28 01:27:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance soft rebooted successfully.
Nov 28 01:27:46 user nova-compute[75266]: DEBUG nova.compute.manager [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.180s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:27:46 user nova-compute[75266]: WARNING nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state active and task_state None.
Nov 28 01:27:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:46 user nova-compute[75266]: DEBUG nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:27:46 user nova-compute[75266]: WARNING nova.compute.manager [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state active and task_state None.
Nov 28 01:27:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:53 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:56 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:27:57 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:27:57 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.94192886352539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:27:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:28:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:28:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:05 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:11 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:28:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:21 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:28:27 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Triggering sync for uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:28:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:28:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:28:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75266) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 01:28:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:28:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=24.941181182861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:28:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:29:00 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:29:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-changed-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG nova.compute.manager [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing instance network info cache due to event network-changed-827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:29:30 user nova-compute[75266]: DEBUG nova.network.neutron [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated VIF entry in instance network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-changed-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.compute.manager [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing instance network info cache due to event network-changed-827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Refreshing network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:29:31 user nova-compute[75266]: INFO nova.compute.manager [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Detaching volume de772352-1a57-4511-9b60-8a9e89341b97
Nov 28 01:29:31 user nova-compute[75266]: INFO nova.virt.block_device [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Attempting to driver detach volume de772352-1a57-4511-9b60-8a9e89341b97 from mountpoint /dev/vdb
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Attempting to detach device vdb from instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:29:31 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:29:31 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:29:31 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:29:31 user nova-compute[75266]:   <serial>de772352-1a57-4511-9b60-8a9e89341b97</serial>
Nov 28 01:29:31 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:29:31 user nova-compute[75266]: </disk>
Nov 28 01:29:31 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:29:31 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully detached device vdb from instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b from the persistent domain config.
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:29:31 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:29:31 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:29:31 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:29:31 user nova-compute[75266]:   <serial>de772352-1a57-4511-9b60-8a9e89341b97</serial>
Nov 28 01:29:31 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:29:31 user nova-compute[75266]: </disk>
Nov 28 01:29:31 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated VIF entry in instance network info cache for port 827702b3-6c9e-4d07-8324-598c38a33808. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG nova.network.neutron [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:29:31 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:29:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b is timed out.
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully detached device vdb from instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b from the live domain config.
Nov 28 01:29:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DevgfVZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:29:52 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f5e0cf-8308-4c6f-a8fe-35a5eeee6fb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:29:52 user nova-compute[75266]: No targets found.
Nov 28 01:29:52 user nova-compute[75266]: iSNS:
Nov 28 01:29:52 user nova-compute[75266]: No targets found.
Nov 28 01:29:52 user nova-compute[75266]: STATIC:
Nov 28 01:29:52 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97
Nov 28 01:29:52 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:29:52 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:29:52 user nova-compute[75266]: FIRMWARE:
Nov 28 01:29:52 user nova-compute[75266]: No targets found.
Nov 28 01:29:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:29:52 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:29:52 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e3033-c56b-413c-bf97-17f7b18863cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bebeba-ebf2-459c-b428-97ec8af91fcc]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)
Nov 28 01:29:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 (non-flash)
Nov 28 01:29:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7bad9ecf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fd9ca8-3fec-470c-81b4-acc6190ab312]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe6b52-0431-4cd0-9bfb-1a05a4a237a2]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1287c-ed7c-4435-a921-5e7d7045812b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f0cf8-555d-4a17-947a-0a2651a15838]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3092a-2b1c-4ee7-8876-820a96043bc3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d158f80e-7622-4755-9261-661315f80ba8]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260]
Nov 28 01:29:52 user nova-compute[75266]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97, portal: 172.16.0.220,3260] successful.
Nov 28 01:29:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de772352-1a57-4511-9b60-8a9e89341b97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c09df-e7c1-470b-90ea-89da62fe43b7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] <== disconnect_volume: return (316ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:29:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:29:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'flavor' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:29:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.681s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:29:55 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:57 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:29:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:29:58 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=24.940425872802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:29:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:30:01 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [{"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:30:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:30:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:25 user nova-compute[75266]: INFO nova.compute.manager [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Terminating instance
Nov 28 01:30:25 user nova-compute[75266]: DEBUG nova.compute.manager [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:30:25 user nova-compute[75266]: DEBUG nova.compute.manager [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-unplugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:30:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Instance destroyed successfully.
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.objects.instance [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'resources' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:25:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1106131125',display_name='tempest-TestMinimumBasicScenario-server-1106131125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1106131125',id=52,image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKk0HMutZ3A7ZcKNBcqzYb2VbFeXHKOMxlkuRwObh2Oe2mwtlTpGXIpQQR7Mgy/j9iU2B54VME97nsb2V2QJpVr1s0iPWYIVi2Du6e0eOYgS6kJvy0AsnOQV1yutIdb+A==',key_name='tempest-TestMinimumBasicScenario-1936314097',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b60fd2418cf34127830ceed618456a71',ramdisk_id='',reservation_id='r-oa5033d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='63ddbc17-c77e-4a11-a873-5d13f598a449',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1587536658',owner_user_name='tempest-TestMinimumBasicScenario-1587536658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:27:46Z,user_data=None,user_id='9840cdc8142e46199dd32a7ea108ea4a',uuid=8eeb3fc2-2a1a-4496-a74a-acda3bb9965b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converting VIF {"id": "827702b3-6c9e-4d07-8324-598c38a33808", "address": "fa:16:3e:f6:93:16", "network": {"id": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-472359106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b60fd2418cf34127830ceed618456a71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap827702b3-6c", "ovs_interfaceid": "827702b3-6c9e-4d07-8324-598c38a33808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG os_vif [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap827702b3-6c, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65623d9b-5cc4-44d6-8e09-5551bfd6d244) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:26 user nova-compute[75266]: INFO os_vif [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:93:16,bridge_name='br-int',has_traffic_filtering=True,id=827702b3-6c9e-4d07-8324-598c38a33808,network=Network(8c0c53ac-6841-49ed-9cab-9b350f8fecbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap827702b3-6c')
Nov 28 01:30:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Deleting instance files /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b_del
Nov 28 01:30:26 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Deletion of /opt/stack/data/nova/instances/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b_del complete
Nov 28 01:30:26 user nova-compute[75266]: INFO nova.compute.manager [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 28 01:30:26 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:30:26 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:30:27 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Took 0.94 seconds to deallocate network for instance.
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-deleted-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:27 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Deleted allocations for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Acquiring lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Lock "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:27 user nova-compute[75266]: DEBUG nova.compute.manager [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] No waiting events found dispatching network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:30:27 user nova-compute[75266]: WARNING nova.compute.manager [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Received unexpected event network-vif-plugged-827702b3-6c9e-4d07-8324-598c38a33808 for instance with vm_state deleted and task_state None.
Nov 28 01:30:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:56 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:30:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:30:58 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:30:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:30:59 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=24.96776580810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:30:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:31:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:31:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:31:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:31:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:18 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:31:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:31:47 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:52 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:31:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:31:58 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:00 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:00 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:32:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:32:01 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.994251251220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:32:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Starting instance... {{(pid=75266) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75266) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 01:32:04 user nova-compute[75266]: INFO nova.compute.claims [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Claim successful on node user
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Start building networks asynchronously for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Allocating IP information in the background. {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] allocate_for_instance() {{(pid=75266) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 01:32:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Start building block device mappings for instance. {{(pid=75266) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.policy [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd808e1f1fd2e4db891dc12d5f9d8f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb9ba5299e44f8988062d107a3ba7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75266) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Start spawning the instance on the hypervisor. {{(pid=75266) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Creating instance directory {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 01:32:04 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Creating image(s)
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "/opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "/opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "/opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.218s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk 1073741824 {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Successfully created port: 10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822,backing_fmt=raw /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk 1073741824" returned: 0 in 0.060s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "09ab84a414a0d584125ec4a73a3925f0f0cda822" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09ab84a414a0d584125ec4a73a3925f0f0cda822 --force-share --output=json" returned: 0 in 0.186s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk. size=1073741824 {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG nova.virt.disk.api [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Cannot resize image /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk to a smaller size. {{(pid=75266) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Created local disks {{(pid=75266) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Ensure instance console log exists: /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/console.log {{(pid=75266) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Successfully updated port: 10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Building network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-changed-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.compute.manager [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Refreshing instance network info cache due to event network-changed-10226b33-a013-4cde-9de0-9f0080ec8a41. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Instance cache missing network info. {{(pid=75266) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Instance network_info: |[{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75266) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Refreshing network info cache for port 10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Start _get_guest_xml network_info=[{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0eca691f-8ae7-4ede-a543-e4f526783da7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 01:32:06 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:32:06 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CPU controller missing on host. {{(pid=75266) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.host [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CPU controller found on host. {{(pid=75266) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75266) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T00:37:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T00:37:38Z,direct_url=<?>,disk_format='qcow2',id=0eca691f-8ae7-4ede-a543-e4f526783da7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ee7a3bfd33a24e66a77d46cd10166206',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T00:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flavor limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Image limits 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flavor pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Image pref 0:0:0 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75266) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Got 1 possible topologies {{(pid=75266) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75266) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-950309669',display_name='tempest-SnapshotDataIntegrityTests-server-950309669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-950309669',id=53,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrz9f14teMjaRBkan8CfcpOatyvAA6p0hfNH4BGV/fO1fVHwG2RVkbP9SlqoB27mdUZy2DWZqGBTP9FXbcSTPfjOWc83gEMV8E/zluINlrJb+V2NZmY85Vyq5NBXrLSmw==',key_name='tempest-keypair-1563997407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cb9ba5299e44f8988062d107a3ba7e1',ramdisk_id='',reservation_id='r-ni3t5h3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-663058346',owner_user_name='tempest-SnapshotDataIntegrityTests-663058346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:32:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d808e1f1fd2e4db891dc12d5f9d8f5e6',uuid=c430513e-9f72-4eae-a522-1b000ef4dab6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75266) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converting VIF {"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'pci_devices' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 01:32:06 user nova-compute[75266]:   <uuid>c430513e-9f72-4eae-a522-1b000ef4dab6</uuid>
Nov 28 01:32:06 user nova-compute[75266]:   <name>instance-00000035</name>
Nov 28 01:32:06 user nova-compute[75266]:   <memory>524288</memory>
Nov 28 01:32:06 user nova-compute[75266]:   <vcpu>1</vcpu>
Nov 28 01:32:06 user nova-compute[75266]:   <metadata>
Nov 28 01:32:06 user nova-compute[75266]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 01:32:06 user nova-compute[75266]:       <nova:package version="0.0.0"/>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-950309669</nova:name>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:creationTime>2023-11-28 01:32:06</nova:creationTime>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:flavor name="m1.tiny">
Nov 28 01:32:06 user nova-compute[75266]:         <nova:memory>512</nova:memory>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:disk>1</nova:disk>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:swap>0</nova:swap>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:vcpus>1</nova:vcpus>
Nov 28 01:32:06 user nova-compute[75266]:       </nova:flavor>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:owner>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:user uuid="d808e1f1fd2e4db891dc12d5f9d8f5e6">tempest-SnapshotDataIntegrityTests-663058346-project-member</nova:user>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:project uuid="8cb9ba5299e44f8988062d107a3ba7e1">tempest-SnapshotDataIntegrityTests-663058346</nova:project>
Nov 28 01:32:06 user nova-compute[75266]:       </nova:owner>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:root type="image" uuid="0eca691f-8ae7-4ede-a543-e4f526783da7"/>
Nov 28 01:32:06 user nova-compute[75266]:       <nova:ports>
Nov 28 01:32:06 user nova-compute[75266]:         <nova:port uuid="10226b33-a013-4cde-9de0-9f0080ec8a41">
Nov 28 01:32:06 user nova-compute[75266]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 01:32:06 user nova-compute[75266]:         </nova:port>
Nov 28 01:32:06 user nova-compute[75266]:       </nova:ports>
Nov 28 01:32:06 user nova-compute[75266]:     </nova:instance>
Nov 28 01:32:06 user nova-compute[75266]:   </metadata>
Nov 28 01:32:06 user nova-compute[75266]:   <sysinfo type="smbios">
Nov 28 01:32:06 user nova-compute[75266]:     <system>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="product">OpenStack Nova</entry>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="version">0.0.0</entry>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="serial">c430513e-9f72-4eae-a522-1b000ef4dab6</entry>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="uuid">c430513e-9f72-4eae-a522-1b000ef4dab6</entry>
Nov 28 01:32:06 user nova-compute[75266]:       <entry name="family">Virtual Machine</entry>
Nov 28 01:32:06 user nova-compute[75266]:     </system>
Nov 28 01:32:06 user nova-compute[75266]:   </sysinfo>
Nov 28 01:32:06 user nova-compute[75266]:   <os>
Nov 28 01:32:06 user nova-compute[75266]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 01:32:06 user nova-compute[75266]:     <boot dev="hd"/>
Nov 28 01:32:06 user nova-compute[75266]:     <smbios mode="sysinfo"/>
Nov 28 01:32:06 user nova-compute[75266]:   </os>
Nov 28 01:32:06 user nova-compute[75266]:   <features>
Nov 28 01:32:06 user nova-compute[75266]:     <acpi/>
Nov 28 01:32:06 user nova-compute[75266]:     <apic/>
Nov 28 01:32:06 user nova-compute[75266]:     <vmcoreinfo/>
Nov 28 01:32:06 user nova-compute[75266]:   </features>
Nov 28 01:32:06 user nova-compute[75266]:   <clock offset="utc">
Nov 28 01:32:06 user nova-compute[75266]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 01:32:06 user nova-compute[75266]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 01:32:06 user nova-compute[75266]:     <timer name="hpet" present="no"/>
Nov 28 01:32:06 user nova-compute[75266]:   </clock>
Nov 28 01:32:06 user nova-compute[75266]:   <cpu mode="custom" match="exact">
Nov 28 01:32:06 user nova-compute[75266]:     <model>Nehalem</model>
Nov 28 01:32:06 user nova-compute[75266]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 01:32:06 user nova-compute[75266]:   </cpu>
Nov 28 01:32:06 user nova-compute[75266]:   <devices>
Nov 28 01:32:06 user nova-compute[75266]:     <disk type="file" device="disk">
Nov 28 01:32:06 user nova-compute[75266]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 01:32:06 user nova-compute[75266]:       <source file="/opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk"/>
Nov 28 01:32:06 user nova-compute[75266]:       <target dev="vda" bus="virtio"/>
Nov 28 01:32:06 user nova-compute[75266]:     </disk>
Nov 28 01:32:06 user nova-compute[75266]:     <interface type="ethernet">
Nov 28 01:32:06 user nova-compute[75266]:       <mac address="fa:16:3e:41:f0:b3"/>
Nov 28 01:32:06 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:32:06 user nova-compute[75266]:       <mtu size="1442"/>
Nov 28 01:32:06 user nova-compute[75266]:       <target dev="tap10226b33-a0"/>
Nov 28 01:32:06 user nova-compute[75266]:     </interface>
Nov 28 01:32:06 user nova-compute[75266]:     <serial type="pty">
Nov 28 01:32:06 user nova-compute[75266]:       <log file="/opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/console.log" append="off"/>
Nov 28 01:32:06 user nova-compute[75266]:     </serial>
Nov 28 01:32:06 user nova-compute[75266]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 01:32:06 user nova-compute[75266]:     <video>
Nov 28 01:32:06 user nova-compute[75266]:       <model type="virtio"/>
Nov 28 01:32:06 user nova-compute[75266]:     </video>
Nov 28 01:32:06 user nova-compute[75266]:     <rng model="virtio">
Nov 28 01:32:06 user nova-compute[75266]:       <backend model="random">/dev/urandom</backend>
Nov 28 01:32:06 user nova-compute[75266]:     </rng>
Nov 28 01:32:06 user nova-compute[75266]:     <controller type="usb" index="0" model="none"/>
Nov 28 01:32:06 user nova-compute[75266]:     <memballoon model="virtio">
Nov 28 01:32:06 user nova-compute[75266]:       <stats period="10"/>
Nov 28 01:32:06 user nova-compute[75266]:     </memballoon>
Nov 28 01:32:06 user nova-compute[75266]:   </devices>
Nov 28 01:32:06 user nova-compute[75266]: </domain>
Nov 28 01:32:06 user nova-compute[75266]:  {{(pid=75266) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-950309669',display_name='tempest-SnapshotDataIntegrityTests-server-950309669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-950309669',id=53,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrz9f14teMjaRBkan8CfcpOatyvAA6p0hfNH4BGV/fO1fVHwG2RVkbP9SlqoB27mdUZy2DWZqGBTP9FXbcSTPfjOWc83gEMV8E/zluINlrJb+V2NZmY85Vyq5NBXrLSmw==',key_name='tempest-keypair-1563997407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cb9ba5299e44f8988062d107a3ba7e1',ramdisk_id='',reservation_id='r-ni3t5h3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-663058346',owner_user_name='tempest-SnapshotDataIntegrityTests-663058346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T01:32:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d808e1f1fd2e4db891dc12d5f9d8f5e6',uuid=c430513e-9f72-4eae-a522-1b000ef4dab6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converting VIF {"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG os_vif [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0') {{(pid=75266) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92a5a0c4-ef49-5503-85be-b27199c92068', '_type': 'linux-noop'}}, row=False) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10226b33-a0, may_exist=True, interface_attrs={}) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10226b33-a0, col_values=(('qos', UUID('2d91b1f5-aaf7-4c5f-a21c-9b2bfc5e3929')),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10226b33-a0, col_values=(('external_ids', {'iface-id': '10226b33-a013-4cde-9de0-9f0080ec8a41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f0:b3', 'vm-uuid': 'c430513e-9f72-4eae-a522-1b000ef4dab6'}),), if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:06 user nova-compute[75266]: INFO os_vif [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0')
Nov 28 01:32:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No VIF found with MAC fa:16:3e:41:f0:b3, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated VIF entry in instance network info cache for port 10226b33-a013-4cde-9de0-9f0080ec8a41. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:32:06 user nova-compute[75266]: DEBUG nova.network.neutron [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:32:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:32:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG nova.compute.manager [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] No waiting events found dispatching network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:32:08 user nova-compute[75266]: WARNING nova.compute.manager [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received unexpected event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 for instance with vm_state building and task_state spawning.
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:08 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Instance event wait completed in 0 seconds for  {{(pid=75266) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Guest created on hypervisor {{(pid=75266) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 01:32:10 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Instance spawned successfully.
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_cdrom_bus of ide {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_disk_bus of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_input_bus of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_pointer_model of None {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_video_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Found default for hw_vif_model of virtio {{(pid=75266) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.compute.manager [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] No waiting events found dispatching network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:32:10 user nova-compute[75266]: WARNING nova.compute.manager [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received unexpected event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 for instance with vm_state building and task_state spawning.
Nov 28 01:32:10 user nova-compute[75266]: INFO nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 28 01:32:10 user nova-compute[75266]: DEBUG nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Checking state {{(pid=75266) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 01:32:10 user nova-compute[75266]: INFO nova.compute.manager [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Took 6.56 seconds to build instance.
Nov 28 01:32:10 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.679s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:32:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:37 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:32:57 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:32:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:33:02 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:33:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:33:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.96184539794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:33:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:16 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:33:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:27 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:33 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:33:33 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:33:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-changed-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG nova.compute.manager [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Refreshing instance network info cache due to event network-changed-10226b33-a013-4cde-9de0-9f0080ec8a41. {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Refreshing network info cache for port 10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated VIF entry in instance network info cache for port 10226b33-a013-4cde-9de0-9f0080ec8a41. {{(pid=75266) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 01:33:55 user nova-compute[75266]: DEBUG nova.network.neutron [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:33:56 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:33:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:33:57 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:33:58 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:33:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:33:58 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG nova.objects.instance [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:33:59 user nova-compute[75266]: INFO nova.compute.manager [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attaching volume 12736964-6b8b-4a18-a355-e4da9f94ad17 to /dev/vdb
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.utils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d291c-e27a-4e4f-8a30-e53a6bb0aa61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa47e2-f525-44f6-8901-e2d2cdea1515]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[829cbd4f-25c3-447c-a571-f174543958b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe256ec-8163-4337-8b12-c1a54041bccd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:33:59 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:33:59 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d16b641-3c2f-40c5-8216-95b1e675378c]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG os_brick.utils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:33:59 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating existing volume attachment record: 93a2ca3f-2252-4162-b221-2bdd8e3334fa {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:34:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:02 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:03 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:34:03 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.961082458496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:34:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:34:04 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AljOfIeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:34:05 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:34:05 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:34:05 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[773edd9f-cf8c-4f34-af12-e0fade96716d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:34:05 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f39ab6-188a-4b8c-80f1-34602b87bfcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17] added
Nov 28 01:34:05 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2292962a-cc13-4f16-8d52-29ab6fe726b3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d42ddb-854c-4e68-881e-de8ffe23ecff]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AljOfIeS {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AljOfIeS" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[25190da6-7e18-45e1-a8ff-aae2d76b4871]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AljOfIeS'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4412c6f-3076-49f7-9a2d-5525ad697871]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba63c1a-82f1-4a04-b159-48feea3a626e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:34:05 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:34:05 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:34:05 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:34:05 user nova-compute[75266]: 
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ed6ae5-f8c3-4cc8-88b8-17f45f24a299]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260]
Nov 28 01:34:05 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260] successful.
Nov 28 01:34:05 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8e5ee5-0e51-4e15-86c0-55d4f5d42073]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:05 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527fe48-1956-486c-a148-8ca1ea362959]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)
Nov 28 01:34:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)
Nov 28 01:34:06 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd3991-e083-4061-9846-c4fee5a4c797]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:34:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AljOfIeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '26565666564333431', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565666564333431', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:34:07 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:34:07 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:34:07 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:34:07 user nova-compute[75266]:   <serial>12736964-6b8b-4a18-a355-e4da9f94ad17</serial>
Nov 28 01:34:07 user nova-compute[75266]: </disk>
Nov 28 01:34:07 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No VIF found with MAC fa:16:3e:41:f0:b3, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.373s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:34:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:12 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:34:20 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:34:20 user nova-compute[75266]: INFO nova.compute.manager [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Detaching volume 12736964-6b8b-4a18-a355-e4da9f94ad17
Nov 28 01:34:21 user nova-compute[75266]: INFO nova.virt.block_device [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attempting to driver detach volume 12736964-6b8b-4a18-a355-e4da9f94ad17 from mountpoint /dev/vdb
Nov 28 01:34:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Attempting to detach device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:34:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:34:21 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:34:21 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:34:21 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:34:21 user nova-compute[75266]:   <serial>12736964-6b8b-4a18-a355-e4da9f94ad17</serial>
Nov 28 01:34:21 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:34:21 user nova-compute[75266]: </disk>
Nov 28 01:34:21 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:34:21 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config.
Nov 28 01:34:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:34:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:34:21 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:34:21 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:34:21 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:34:21 user nova-compute[75266]:   <serial>12736964-6b8b-4a18-a355-e4da9f94ad17</serial>
Nov 28 01:34:21 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:34:21 user nova-compute[75266]: </disk>
Nov 28 01:34:21 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:34:21 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:34:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:41 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 is timed out.
Nov 28 01:34:41 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config.
Nov 28 01:34:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AljOfIeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:34:41 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02fb414-8675-4d16-b364-2a428a178923]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:34:41 user nova-compute[75266]: No targets found.
Nov 28 01:34:41 user nova-compute[75266]: iSNS:
Nov 28 01:34:41 user nova-compute[75266]: No targets found.
Nov 28 01:34:41 user nova-compute[75266]: STATIC:
Nov 28 01:34:41 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17
Nov 28 01:34:41 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:34:41 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:34:41 user nova-compute[75266]: FIRMWARE:
Nov 28 01:34:41 user nova-compute[75266]: No targets found.
Nov 28 01:34:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:34:41 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:34:41 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f84694-bba1-4186-ba68-ffd2d1c3d4eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82d200-cbc0-476c-b844-2a52fc7d3b98]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)
Nov 28 01:34:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 (non-flash)
Nov 28 01:34:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c732320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747679f-0f58-415e-8d37-45c52c8da250]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e5fbd8-f1dd-4a23-8789-29913dc89631]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a667d07-0f4f-4f2c-a7b1-55acb920dbe7]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79055223-0965-4917-8621-fd8e3a656271]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ed4ec-66c9-48a4-a12c-1120f7c11e75]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9424f-754d-40e9-a1c6-703a9032329c]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260]
Nov 28 01:34:41 user nova-compute[75266]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17, portal: 172.16.0.220,3260] successful.
Nov 28 01:34:41 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12736964-6b8b-4a18-a355-e4da9f94ad17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[62090c0b-9868-4729-aa20-bb5c5b818b57]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== disconnect_volume: return (298ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:34:41 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:34:42 user nova-compute[75266]: DEBUG nova.objects.instance [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:34:42 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:34:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:34:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:34:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:35:03 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:05 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:35:05 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.960033416748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:35:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:35:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:35:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:12 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:35:14 user nova-compute[75266]: INFO nova.compute.manager [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attaching volume 6243f285-db37-4867-99b4-050f06888d3a to /dev/vdb
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.utils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f7141-7734-4e5b-a143-fff351b919e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916ebcc-e2f8-421f-a306-c638c040a9d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5787b-c299-4441-bc23-860656b8998a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b595d84-74d9-4e4f-9a92-e3417af03338]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:35:14 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:35:14 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a2887-d4b0-4e81-a719-1b763af155e0]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG os_brick.utils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:35:14 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating existing volume attachment record: 7cf405ef-5bc7-4146-9338-22c908a2af73 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:35:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:17 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSPwvEeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:35:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:35:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:35:20 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a45a32c-f2ab-4b79-b832-59f73644f76d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:35:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373d9c8-acdd-4d5a-b6e5-7ae15880942c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a] added
Nov 28 01:35:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15e23f-9abf-4aae-b75c-49fd1a85ba09]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[706acf49-c5a0-4704-89e8-62586ecccaa1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSPwvEeH {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSPwvEeH" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[3048f351-9802-4d3b-9fbd-11e2ca343a26]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lSPwvEeH'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950dd3a-b978-4d45-9f4e-723ed50a83c5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb63f62-18ad-444c-9c2c-8a5582dbab47]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:35:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:35:20 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:35:20 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:35:20 user nova-compute[75266]: 
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc10a63-5388-4737-8d0c-74ba3f3aed4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260]
Nov 28 01:35:20 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260] successful.
Nov 28 01:35:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c85b4-d8c7-4035-988c-7f62b7314b01]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd1926c-ed31-47a1-9b06-7e1da8a41e5d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)
Nov 28 01:35:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)
Nov 28 01:35:20 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76c964-8e1d-4cf0-b9a2-6e0c37a8eda7]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:20 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:35:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:21 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:35:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSPwvEeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23963373934316262', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963373934316262', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.objects.instance [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:35:22 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:35:22 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:35:22 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:35:22 user nova-compute[75266]:   <serial>6243f285-db37-4867-99b4-050f06888d3a</serial>
Nov 28 01:35:22 user nova-compute[75266]: </disk>
Nov 28 01:35:22 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No VIF found with MAC fa:16:3e:41:f0:b3, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:35:22 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.298s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:35:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:35:24 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:35:24 user nova-compute[75266]: INFO nova.compute.manager [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Detaching volume 6243f285-db37-4867-99b4-050f06888d3a
Nov 28 01:35:24 user nova-compute[75266]: INFO nova.virt.block_device [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attempting to driver detach volume 6243f285-db37-4867-99b4-050f06888d3a from mountpoint /dev/vdb
Nov 28 01:35:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Attempting to detach device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:35:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:35:24 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:35:24 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:35:24 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:35:24 user nova-compute[75266]:   <serial>6243f285-db37-4867-99b4-050f06888d3a</serial>
Nov 28 01:35:24 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:35:24 user nova-compute[75266]: </disk>
Nov 28 01:35:24 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:35:24 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config.
Nov 28 01:35:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:35:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:35:24 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:35:24 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:35:24 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:35:24 user nova-compute[75266]:   <serial>6243f285-db37-4867-99b4-050f06888d3a</serial>
Nov 28 01:35:24 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:35:24 user nova-compute[75266]: </disk>
Nov 28 01:35:24 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:35:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:45 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 is timed out.
Nov 28 01:35:45 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config.
Nov 28 01:35:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSPwvEeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:35:45 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e253a9f4-5dd0-430a-a236-2efa94d20a28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:35:45 user nova-compute[75266]: No targets found.
Nov 28 01:35:45 user nova-compute[75266]: iSNS:
Nov 28 01:35:45 user nova-compute[75266]: No targets found.
Nov 28 01:35:45 user nova-compute[75266]: STATIC:
Nov 28 01:35:45 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a
Nov 28 01:35:45 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:35:45 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:35:45 user nova-compute[75266]: FIRMWARE:
Nov 28 01:35:45 user nova-compute[75266]: No targets found.
Nov 28 01:35:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:35:45 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:35:45 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c26dc-9113-410c-ba2f-91f9f0ac8cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ab502-c20d-4a2c-ad92-e834403cae3a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)
Nov 28 01:35:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a (non-flash)
Nov 28 01:35:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c3b7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bfc769-5421-466a-87df-31521ca1cf41]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f103c-a681-40d1-afed-b32efa3d86de]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba4e65-61c9-4e90-9fbd-4192bb6a431e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e8405-0d91-42a6-9dac-d12de3cd567f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edb639c-e5de-466c-86fa-ba6bea73a50f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b662829-5118-42ae-b4c9-ff9ccc837328]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260]
Nov 28 01:35:45 user nova-compute[75266]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a, portal: 172.16.0.220,3260] successful.
Nov 28 01:35:45 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6243f285-db37-4867-99b4-050f06888d3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eadf944-e065-457c-a67c-36b777a73fa0]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== disconnect_volume: return (284ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:35:45 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:35:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:35:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:35:59 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:36:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.959083557128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:36:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:36:05 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:36:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:13 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:36:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG nova.objects.instance [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:36:17 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:36:17 user nova-compute[75266]: INFO nova.compute.manager [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attaching volume 23385482-4420-4214-afd9-61159b8296a4 to /dev/vdb
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.utils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04af240-4958-43ae-bf19-c8ceec2c7dd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4775f92-b8af-4428-b7b6-246ce1d6ee6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d371a7fe-3d46-43ac-9cdd-35fae5f36f3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded2b7fb-8882-4441-8b14-998fb716c1f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:36:18 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:36:18 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec60ddd-dba2-4ef3-80d6-95bfb8bed5a9]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG os_brick.utils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:36:18 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating existing volume attachment record: 46e3a34e-9ca7-4a7a-8b49-237300abbc66 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:36:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFqTkySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:36:24 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:36:24 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:36:24 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[79265081-fa9c-4532-a264-2b0740ab0248]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:36:24 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d291383-a1fb-4b82-9d1e-a0ca03308b40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4] added
Nov 28 01:36:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ccaa2d-695f-4e20-8b39-28928babea13]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6f8d78-b60b-4d35-8e0d-5a840fec8e82]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFqTkySd {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFqTkySd" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b683c2-7995-4b97-8db9-bfc5343fc35f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFqTkySd'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf070db-01e9-4b39-8bac-08abf71cbbc3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[22912b20-a289-4536-b9b8-1da467ef2c17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:36:24 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:36:24 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:36:24 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:36:24 user nova-compute[75266]: 
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e2dad-7585-4a6e-a90e-0a3d3f912a14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260]
Nov 28 01:36:24 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260] successful.
Nov 28 01:36:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59e704-1cfc-4877-81ea-2e24adcd860c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3505949-96f7-4aa4-ac31-9bad9ff48242]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)
Nov 28 01:36:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)
Nov 28 01:36:24 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f68af-38f1-4e0d-bc6b-1546e644349c]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:36:24 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFqTkySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:36:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:36:25 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23130393361303730', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:36:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393361303730', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:36:25 user nova-compute[75266]: DEBUG nova.objects.instance [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:36:25 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:36:25 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:36:25 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:36:25 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:36:25 user nova-compute[75266]:   <serial>23385482-4420-4214-afd9-61159b8296a4</serial>
Nov 28 01:36:25 user nova-compute[75266]: </disk>
Nov 28 01:36:25 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:36:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:36:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:36:26 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No VIF found with MAC fa:16:3e:41:f0:b3, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:36:26 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.544s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:36:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:27 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:36:28 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:36:28 user nova-compute[75266]: INFO nova.compute.manager [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Detaching volume 23385482-4420-4214-afd9-61159b8296a4
Nov 28 01:36:28 user nova-compute[75266]: INFO nova.virt.block_device [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attempting to driver detach volume 23385482-4420-4214-afd9-61159b8296a4 from mountpoint /dev/vdb
Nov 28 01:36:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Attempting to detach device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:36:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:36:28 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:36:28 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:36:28 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:36:28 user nova-compute[75266]:   <serial>23385482-4420-4214-afd9-61159b8296a4</serial>
Nov 28 01:36:28 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:36:28 user nova-compute[75266]: </disk>
Nov 28 01:36:28 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:36:28 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config.
Nov 28 01:36:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:36:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:36:28 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:36:28 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:36:28 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:36:28 user nova-compute[75266]:   <serial>23385482-4420-4214-afd9-61159b8296a4</serial>
Nov 28 01:36:28 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:36:28 user nova-compute[75266]: </disk>
Nov 28 01:36:28 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:36:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:36:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:36:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:48 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 is timed out.
Nov 28 01:36:48 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config.
Nov 28 01:36:48 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFqTkySd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:36:48 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796c4c8-242d-4c74-979f-294dc95eabc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:36:48 user nova-compute[75266]: No targets found.
Nov 28 01:36:48 user nova-compute[75266]: iSNS:
Nov 28 01:36:48 user nova-compute[75266]: No targets found.
Nov 28 01:36:48 user nova-compute[75266]: STATIC:
Nov 28 01:36:48 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4
Nov 28 01:36:48 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:36:48 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:36:48 user nova-compute[75266]: FIRMWARE:
Nov 28 01:36:48 user nova-compute[75266]: No targets found.
Nov 28 01:36:48 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:36:48 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:36:48 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ead7d9-fb5b-447e-af05-6ad26a3b3697]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:48 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd2824-25f0-4092-a08e-14e73bbc1db3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)
Nov 28 01:36:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 (non-flash)
Nov 28 01:36:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c59c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5ae327-e9ec-4328-a0c6-fae470d089c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de8743-ba21-4cdc-8627-84aea2052039]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f417c1-c098-4252-bc9d-68ebcdfafc3a]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e67cc7-e874-4e78-9b90-eab6aaf28560]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e389a16-9dfc-4208-a381-0c4d80dfae66]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[c448e2da-1e4d-46b8-9df0-22da8a3b8e11]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260]
Nov 28 01:36:49 user nova-compute[75266]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4, portal: 172.16.0.220,3260] successful.
Nov 28 01:36:49 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23385482-4420-4214-afd9-61159b8296a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f63dd-dc10-4d7e-8f85-de9afee308ba]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== disconnect_volume: return (279ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:36:49 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:36:50 user nova-compute[75266]: DEBUG nova.objects.instance [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:36:50 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:36:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:36:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:00 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:37:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:37:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.958049774169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:37:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:37:06 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:37:09 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:15 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG nova.objects.instance [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:37:21 user nova-compute[75266]: INFO nova.compute.manager [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attaching volume 77272474-7175-44e9-8a14-8cb66af9890d to /dev/vdb
Nov 28 01:37:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG os_brick.utils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[804a4db9-908b-416f-b7aa-6dc2ff1b536d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dbcb45749b57\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd67a6aa-3fd7-486a-83fd-49ace681680f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37db253-3371-4d51-acf3-cc96501ee0e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d1950-e522-492e-b6da-77e1c476b5d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Running cmd (subprocess): nvme version {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] nvme not present on system {{(pid=75266) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 01:37:21 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 01:37:22 user nova-compute[75266]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 01:37:22 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dcbbf-9cf2-4543-ac46-a9e152f23807]: (4, '') {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75266) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.lightos [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] LIGHTOS: no hostnqn found. {{(pid=75266) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG os_brick.utils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dbcb45749b57', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG nova.virt.block_device [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating existing volume attachment record: c2bba1ef-99e0-4bc9-b209-4cd3ffbe4ff3 {{(pid=75266) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 01:37:22 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Calling os-brick to attach iSCSI Volume {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seqiXQPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:37:28 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:37:28 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:37:28 user nova-compute[75266]: INFO os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca9ae9-ae93-4e3b-8020-d22eb1a47e84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 01:37:28 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --interface default --op new {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f318b7-adf1-41cb-8f24-15213f21936c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d] added\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d] added
Nov 28 01:37:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba9638-d763-4f7c-8554-948cf44ea1a1]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e8f6b0-0d41-4c6a-b91c-24d0d41e77c3]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seqiXQPY {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seqiXQPY" returned: 0 in 0.024s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6973e0-ae13-45e3-9c69-84bdf5eff1d5]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'seqiXQPY'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b441bb-a09b-4ad9-9b7e-50a53c6f50fa]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[28324649-7351-4968-baf2-94b27154c8bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:37:28 user nova-compute[75266]:  {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 01:37:28 user nova-compute[75266]:  {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:37:28 user nova-compute[75266]: WARNING os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 01:37:28 user nova-compute[75266]: 
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --login {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[43720723-f6ba-41b3-a7ae-af58b1cfe71f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260]
Nov 28 01:37:28 user nova-compute[75266]: Login to [iface: default, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260] successful.
Nov 28 01:37:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa902578-9b60-4e65-ac92-2213337b771f]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba423280-e9dc-441f-8564-c48e45df9850]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)
Nov 28 01:37:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)
Nov 28 01:37:28 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to 172.16.0.220:3260 {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75266) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75266) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27dc79-bf56-4dba-be7b-7c041b9fc5f0]: (4, ('- - 0', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:28 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75266) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seqiXQPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75266) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26566343439343136', 'path': '/dev/sdb'} {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343439343136', 'path': '/dev/sdb'} {{(pid=75266) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG nova.objects.instance [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:37:29 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 01:37:29 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:37:29 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:37:29 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:37:29 user nova-compute[75266]:   <serial>77272474-7175-44e9-8a14-8cb66af9890d</serial>
Nov 28 01:37:29 user nova-compute[75266]: </disk>
Nov 28 01:37:29 user nova-compute[75266]:  {{(pid=75266) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 01:37:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:37:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75266) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 01:37:30 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] No VIF found with MAC fa:16:3e:41:f0:b3, not building metadata {{(pid=75266) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 01:37:30 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.504s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:37:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:37:32 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:37:32 user nova-compute[75266]: INFO nova.compute.manager [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Detaching volume 77272474-7175-44e9-8a14-8cb66af9890d
Nov 28 01:37:32 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:32 user nova-compute[75266]: INFO nova.virt.block_device [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Attempting to driver detach volume 77272474-7175-44e9-8a14-8cb66af9890d from mountpoint /dev/vdb
Nov 28 01:37:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Attempting to detach device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config. {{(pid=75266) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 01:37:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:37:32 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:37:32 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:37:32 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:37:32 user nova-compute[75266]:   <serial>77272474-7175-44e9-8a14-8cb66af9890d</serial>
Nov 28 01:37:32 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:37:32 user nova-compute[75266]: </disk>
Nov 28 01:37:32 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:37:32 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the persistent domain config.
Nov 28 01:37:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config. {{(pid=75266) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 01:37:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.guest [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 01:37:32 user nova-compute[75266]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 01:37:32 user nova-compute[75266]:   <source dev="/dev/sdb"/>
Nov 28 01:37:32 user nova-compute[75266]:   <target dev="vdb" bus="virtio"/>
Nov 28 01:37:32 user nova-compute[75266]:   <serial>77272474-7175-44e9-8a14-8cb66af9890d</serial>
Nov 28 01:37:32 user nova-compute[75266]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 01:37:32 user nova-compute[75266]: </disk>
Nov 28 01:37:32 user nova-compute[75266]:  {{(pid=75266) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 01:37:32 user nova-compute[75266]: DEBUG nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 01:37:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:37:52 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c430513e-9f72-4eae-a522-1b000ef4dab6 is timed out.
Nov 28 01:37:52 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully detached device vdb from instance c430513e-9f72-4eae-a522-1b000ef4dab6 from the live domain config.
Nov 28 01:37:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] calling os-brick to detach iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7b9c3da590>, {'target_iqn': 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seqiXQPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 01:37:52 user nova-compute[75266]: WARNING os_brick.initiator.connectors.base [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99005a-ea50-4421-a072-9902a388ed4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 01:37:52 user nova-compute[75266]: No targets found.
Nov 28 01:37:52 user nova-compute[75266]: iSNS:
Nov 28 01:37:52 user nova-compute[75266]: No targets found.
Nov 28 01:37:52 user nova-compute[75266]: STATIC:
Nov 28 01:37:52 user nova-compute[75266]: Target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d
Nov 28 01:37:52 user nova-compute[75266]:         Portal: 172.16.0.220:3260,-1
Nov 28 01:37:52 user nova-compute[75266]:                 Iface Name: default
Nov 28 01:37:52 user nova-compute[75266]: FIRMWARE:
Nov 28 01:37:52 user nova-compute[75266]: No targets found.
Nov 28 01:37:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 01:37:52 user nova-compute[75266]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 01:37:52 user nova-compute[75266]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75266) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d', 0)] {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[786174d1-f0b3-4a5d-8b94-85cc03384571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8ede3-23c0-47cd-8b24-6cf4e5bf1ed8]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)
Nov 28 01:37:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d (non-flash)
Nov 28 01:37:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7b9c33a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d'): ({'sdb'}, set())}) {{(pid=75266) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Removing single pathed devices sdb {{(pid=75266) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c69135-1c77-4049-aa45-c8248b4f5dec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad903d7b-1bf9-4ec5-879e-fa97fbf95c04]: (4, ('ok\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flushing IO for device /dev/sdb {{(pid=75266) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[417aa872-4495-4912-851e-87951637f29c]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75266) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1258438-57ca-4958-90a0-b4a5e3c4ee4f]: (4, ('1', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.linuxscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] SCSI volumes sdb have been removed. {{(pid=75266) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d')] {{(pid=75266) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a1fee5-ffee-44b2-9dc5-a2bc9596b70b]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --logout {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60c7ba-4a52-453f-a71e-17054099b73c]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260]
Nov 28 01:37:52 user nova-compute[75266]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d, portal: 172.16.0.220,3260] successful.
Nov 28 01:37:52 user nova-compute[75266]:  stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op delete {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77272474-7175-44e9-8a14-8cb66af9890d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86532) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98287a-28b2-4609-aeef-a5edc2a9ef0e]: (4, ('', '')) {{(pid=86532) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75266) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.base [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG os_brick.initiator.connectors.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] <== disconnect_volume: return (286ms) None {{(pid=75266) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 01:37:52 user nova-compute[75266]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Disconnected iSCSI Volume {{(pid=75266) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 01:37:53 user nova-compute[75266]: DEBUG nova.objects.instance [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'flavor' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:37:53 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:37:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:02 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:38:03 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG oslo_concurrency.processutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75266) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 01:38:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:38:04 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.95709991455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Instance c430513e-9f72-4eae-a522-1b000ef4dab6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75266) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:38:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:06 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquired lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Forcefully refreshing network info cache for instance {{(pid=75266) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 01:38:07 user nova-compute[75266]: DEBUG nova.objects.instance [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lazy-loading 'info_cache' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:38:08 user nova-compute[75266]: DEBUG nova.network.neutron [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [{"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:38:08 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Releasing lock "refresh_cache-c430513e-9f72-4eae-a522-1b000ef4dab6" {{(pid=75266) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 01:38:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updated the network info_cache for instance {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 01:38:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:38:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:10 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:12 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75266) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:17 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:39 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:41 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:38:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Cleaning up deleted instances {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 01:38:41 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] There are 0 instances to clean {{(pid=75266) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 01:38:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:45 user nova-compute[75266]: INFO nova.compute.manager [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Terminating instance
Nov 28 01:38:45 user nova-compute[75266]: DEBUG nova.compute.manager [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Start destroying the instance on the hypervisor. {{(pid=75266) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-unplugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] No waiting events found dispatching network-vif-unplugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:38:45 user nova-compute[75266]: DEBUG nova.compute.manager [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-unplugged-10226b33-a013-4cde-9de0-9f0080ec8a41 for instance with task_state deleting. {{(pid=75266) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Instance destroyed successfully.
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.objects.instance [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'resources' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=75266) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.virt.libvirt.vif [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T01:32:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-950309669',display_name='tempest-SnapshotDataIntegrityTests-server-950309669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-950309669',id=53,image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrz9f14teMjaRBkan8CfcpOatyvAA6p0hfNH4BGV/fO1fVHwG2RVkbP9SlqoB27mdUZy2DWZqGBTP9FXbcSTPfjOWc83gEMV8E/zluINlrJb+V2NZmY85Vyq5NBXrLSmw==',key_name='tempest-keypair-1563997407',keypairs=<?>,launch_index=0,launched_at=2023-11-28T01:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cb9ba5299e44f8988062d107a3ba7e1',ramdisk_id='',reservation_id='r-ni3t5h3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0eca691f-8ae7-4ede-a543-e4f526783da7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-663058346',owner_user_name='tempest-SnapshotDataIntegrityTests-663058346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T01:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d808e1f1fd2e4db891dc12d5f9d8f5e6',uuid=c430513e-9f72-4eae-a522-1b000ef4dab6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converting VIF {"id": "10226b33-a013-4cde-9de0-9f0080ec8a41", "address": "fa:16:3e:41:f0:b3", "network": {"id": "45fc1afa-7b94-488c-afea-48be247a070f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1093532977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cb9ba5299e44f8988062d107a3ba7e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10226b33-a0", "ovs_interfaceid": "10226b33-a013-4cde-9de0-9f0080ec8a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.network.os_vif_util [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0') {{(pid=75266) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG os_vif [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0') {{(pid=75266) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10226b33-a0, bridge=br-int, if_exists=True) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d91b1f5-aaf7-4c5f-a21c-9b2bfc5e3929) {{(pid=75266) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:46 user nova-compute[75266]: INFO os_vif [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f0:b3,bridge_name='br-int',has_traffic_filtering=True,id=10226b33-a013-4cde-9de0-9f0080ec8a41,network=Network(45fc1afa-7b94-488c-afea-48be247a070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10226b33-a0')
Nov 28 01:38:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Deleting instance files /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6_del
Nov 28 01:38:46 user nova-compute[75266]: INFO nova.virt.libvirt.driver [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Deletion of /opt/stack/data/nova/instances/c430513e-9f72-4eae-a522-1b000ef4dab6_del complete
Nov 28 01:38:46 user nova-compute[75266]: INFO nova.compute.manager [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 01:38:46 user nova-compute[75266]: DEBUG oslo.service.loopingcall [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75266) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.compute.manager [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Deallocating network for instance {{(pid=75266) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 01:38:46 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] deallocate_for_instance() {{(pid=75266) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.network.neutron [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Updating instance_info_cache with network_info: [] {{(pid=75266) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 01:38:47 user nova-compute[75266]: INFO nova.compute.manager [-] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Took 1.01 seconds to deallocate network for instance.
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.compute.manager [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-deleted-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Refreshing inventories for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Updating ProviderTree inventory for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Updating inventory in ProviderTree for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Refreshing aggregate associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, aggregates: None {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Refreshing trait associations for resource provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47, traits: HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41 {{(pid=75266) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:38:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:47 user nova-compute[75266]: INFO nova.scheduler.client.report [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Deleted allocations for instance c430513e-9f72-4eae-a522-1b000ef4dab6
Nov 28 01:38:47 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.377s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 01:38:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Acquiring lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:38:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:38:48 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Lock "c430513e-9f72-4eae-a522-1b000ef4dab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:38:48 user nova-compute[75266]: DEBUG nova.compute.manager [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] No waiting events found dispatching network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 {{(pid=75266) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 01:38:48 user nova-compute[75266]: WARNING nova.compute.manager [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Received unexpected event network-vif-plugged-10226b33-a013-4cde-9de0-9f0080ec8a41 for instance with vm_state deleted and task_state None.
Nov 28 01:38:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:38:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:39:04 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75266) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 01:39:05 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:39:05 user nova-compute[75266]: WARNING nova.virt.libvirt.driver [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=24.97637176513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75266) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75266) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.compute.provider_tree [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed in ProviderTree for provider: 6332c2c0-e5e9-4188-a49b-d53a0e699e47 {{(pid=75266) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.scheduler.client.report [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Inventory has not changed for provider 6332c2c0-e5e9-4188-a49b-d53a0e699e47 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75266) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG nova.compute.resource_tracker [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Compute_service record updated for user:user {{(pid=75266) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 01:39:05 user nova-compute[75266]: DEBUG oslo_concurrency.lockutils [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75266) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 01:39:06 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75266) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Starting heal instance info cache {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Rebuilding the list of instances to heal {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 01:39:08 user nova-compute[75266]: DEBUG nova.compute.manager [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Didn't find any instances for network info cache update. {{(pid=75266) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75266) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75266) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:11 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:12 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:16 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:18 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:18 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 01:39:21 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:26 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:31 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:36 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:39 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:41 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:42 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:46 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:39:51 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 01:39:56 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:40:01 user nova-compute[75266]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75266) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 01:40:04 user nova-compute[75266]: DEBUG oslo_service.periodic_task [None req-d8da16ab-f14d-4a27-9373-978272bb30f5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75266) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}